Author: Mike S.
Date: 09:50:47 02/19/06
Go up one level in this thread
On February 19, 2006 at 11:49:55, Kirill Kryukov wrote: >Hi all! I am happy to announce the weekly update of CCRL rating list and >statistics: > >http://ccrl.computerchess.org.uk/4040/ Thanks! - I see 6 engines, ranks #2 to #7 within only 19 Elos (2830-2849) with the error margins being bigger than +/- 20. (But this includes 2 deeps on duals.) This is remarkable and tells us that these many engines are virtually equally strong, in comp-comp under the CCRL conditions. Or if they are not equally strong (and I don't doubt that some will want to claim this :-)), then it seems to be very hard to prove even with hundred of games. Maybe the gaps will become bigger with 1.000+ games each, or maybe not... I also find the engine correlation statistics very interesting. For example, the "most different" engines seem to be Fritz compared to Ktulu and Tiger, 0.93 rating difference. Surprising about this is, that we find the 2nd biggest rating diff between Ktulu and Tiger. So, all these 3 are very different. This is useful for example, if you prefer one engine for analysis mainly, but want to choose the best engine for "2nd opinions." Then it makes sense IMO, to chose the engine which is most different, from your collection (at least for the middlegame). We also learn from the engine correlation statistics, that there is a typical minimum of ~52% correctly expected moves, but no engine has yet achieved 62% average. Any head-to-head comparison was smaller than 80%, even with closely related engines; see i.e. DJ9/J9 77%. We also find high values between engines and their predecessing versions each (like H9/H10). Regards, Mike Scheidl
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.