Author: George Tsavdaris
Date: 03:10:05 10/18/05
Go up one level in this thread
On October 18, 2005 at 05:59:08, Graham Banks wrote: >>>No opening books >>>Standings after Round 32 >>> >>>20.5 - D1 Meandros >>>20.0 - WoDra ........... ........... >>>12.5 - Solomon >>>12.0 - Default >>>12.0 - Cobra >>>11.0 - Vegeta 2d >> >>No proof. >> >>number of games is not enough. >> >>The same program can score 12/32 in one tournament and 20/32 in another >>tournament even without changing the time control. >> >Not under these conditions if you look - "no books" Yes, but how do you know that the results will be the same when opening books will be set to ON? Perhaps CMDefault would be stronger from D1 Meandros for example, when it plays with book ON....... So you should provide a tournament with book ON and with a much higher number of games, to be able to tell this a "proof". But even then it would be no proof since you will have to include and non-CM engines. And the number of these engines should be big. For example 10-20 non-CM engines have to participate...... > > >>It is also no proof when you test only against chessmaster personalities because >>it is possible that the default personality is worse at longer time control >>against other CM personalities but it is not the case when you test against >>other opponents like Fruit,Fritz,Ktulu. > >A good point Uri, but in my experience in testing both CM9000 and CM10th >Edition, the majority of these settings also outperform the default settings at >longer time controls. >Ray can provide proof of this with both default and all settings he's tested >having played 320 games against other programs. >Not too much point arguing CM10th testing with us as we've been doing it a long >time under many different scenarios. We will be close to call something a "proof" only when: There is a tournament that each engine will play at least 300 or more games, it will play with book=ON (because that is the way engines will play decent Chess and not doubtful openings) and it will have at least 15-20 top, semi-top engines different from Chessmaster.
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.