Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Help with statistics, how do I calculate which engine is probably better

Author: Dann Corbit

Date: 23:33:12 04/10/03

Go up one level in this thread


On April 11, 2003 at 02:18:43, Albert Bertilsson wrote:

>Hi!
>
>When testing my new engine against my old engine I'd like to have some
>estimation of how probable it is that the engine has become stronger.
>
>How do I calculate that? I guess there is some formula, I'd like to learn it.
>
>For example new version beats old version by 26-24 in 50 games. Is it stronger
>(with some probability I guess)? If possible, how much stronger? How many games
>should be played to get fairly accurate numbers when the engine is only a little
>better?
>
>I guess 10 games is to little but I can't do any development if I need 500 games
>to know if it has improved.

http://www.stevemaughan.com/whoisbetter.htm

Also elostat



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.