Computer Chess Club Archives

Search

Terms

Messages

Subject: Help with statistics, how do I calculate which engine is probably better

Author: Albert Bertilsson

Date: 23:18:43 04/10/03

Hi!

When testing my new engine against my old engine I'd like to have some
estimation of how probable it is that the engine has become stronger.

How do I calculate that? I guess there is some formula, I'd like to learn it.

For example new version beats old version by 26-24 in 50 games. Is it stronger
(with some probability I guess)? If possible, how much stronger? How many games
should be played to get fairly accurate numbers when the engine is only a little
better?

I guess 10 games is to little but I can't do any development if I need 500 games
to know if it has improved.

/Regards Albert

Re: Help with statistics, how do I calculate which engine is probably better Dann Corbit 23:33:12 04/10/03
- Re: Help with statistics, how do I calculate which engine is probably better Rémi Coulom 07:58:45 04/11/03

This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.