Computer Chess Club Archives


Search

Terms

Messages

Subject: CEGT or how many games are needed?

Author: Heinz van Kempen

Date: 05:50:45 03/30/05


Hi all  :) ,

we updated our CEGT websites again and now have 859 games for most engines. The
rating list is here:

http://www.husvankempen.de/nunn/cegt.html

The list itself is not astonishing, but when one compares total results from
CEGT 1 with 510 games for each engine with those of CEGT 2 with 349 games for
each engine, testers will have to confess that it is practically impossible to
measure the strength of engines with less than 1000 games and we should stop to
draw conclusions from shorter tournaments. Just compare Junior and Fritz or
Gandalf in CEGT 1 and 2.

This is independent of time control, although I hoped it would be less extreme
with our longer time control. It is also independent of using Nunn, Noomen or
general books, as we now used almost all Nunn positions to cover the most
important openings and Charles with general books also has the same differences.

We will push the CEGT tournaments to more than 1000 games for each engine to
reduce the error bars.

http://www.chessfighters.de/cegt/
http://www.husvankempen.de/nunn/

Please also read about AEGT starting these days.

Best Regards
Heinz



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.