Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: There is no significant difference between the top programs :-)

Author: Jorge Pichard

Date: 14:37:55 08/27/03

Go up one level in this thread


On August 27, 2003 at 17:09:36, George Tsavdaris wrote:

>On August 27, 2003 at 16:05:58, Kurt Utzinger wrote:
>
>>
>>The end of the tournament is indeed very exiting. The first time in the
>>tournament The King 3.23 skr with general.ctg takes the lead together
>>with Shredder 7.04 but Junior 8 is only a half point behind and with
>>only four rounds to go all can happen. Who will be the lucky winner
>>after total 280 games, 70 games per engine? One thing is however
>>clear: the book general.ctg is much better for The King 3.23 skr
>>than the remis.ctg.
>
>I bet on Shredder in both tables! Even now i can't believe the bad
>performance of Hiarcs 8 and especially Chess Tiger 15.0. Why this happened?
>It's a mystery. Maybe 70 more games and things would change.
>But one thing is clear: engine strength is a complicated equation that depends
>on: opening books,hardware speed,permanent brain,hash size,luck?,time
>controls,the opponents,endgame tablebases,book learning and even if you
>keep these parameters (except luck) the same, for finding the best we need
>many many games (to eliminate luck).


There is no significant difference between the top programs, it all depends on
the confidence interval of the estimator (the true value lies with 95/99%
probability in this region). This is what the Swedes do in the SSDF lists
according to Chrilly Donninger:

http://www.chessbase.com/newsdetail.asp?newsid=1146


>>    Program                            Score     %    Av.Op.  Elo    +   -
>>
>>  1 TK 3.23 skr general.ctg        :  40.5/ 66  61.4   2490   2571   75  59
>>  2 Shredder 7.04                  :  40.5/ 66  61.4   2489   2570   75  59
>>  3 Junior 8.0.0.2                 :  40.0/ 66  60.6   2490   2565   75  63
>>  4 Fritz 8.0.0.8                  :  37.0/ 66  56.1   2495   2537   80  63
>>  5 Deep Sjeng 1.5                 :  29.5/ 66  44.7   2506   2469   64  81
>>  6 Chess Tiger 15.0               :  27.5/ 66  41.7   2508   2450   52  78
>>  7 Ruffian 1.0.5                  :  27.0/ 66  40.9   2508   2444   57  77
>>  8 Hiarcs 8                       :  22.0/ 66  33.3   2516   2395   60  70
>>
>>
>>
>>    Program                            Score     %    Av.Op.  Elo    +   -
>>
>>  1 Shredder 7.04                  :  41.0/ 66  62.1   2489   2575   74  61
>>  2 Junior 8.0.0.2                 :  40.5/ 66  61.4   2488   2569   75  62
>>  3 Fritz 8.0.0.8                  :  39.5/ 66  59.8   2492   2561   76  70
>>  4 Deep Sjeng 1.5                 :  32.0/ 66  48.5   2501   2491   62  86
>>  5 TK 3.23 skr remis.ctg          :  31.5/ 66  47.7   2502   2486   60  85
>>  6 Ruffian 1.0.5                  :  29.5/ 66  44.7   2505   2468   54  81
>>  7 Chess Tiger 15.0               :  27.5/ 66  41.7   2508   2449   52  78
>>  8 Hiarcs 8                       :  22.5/ 66  34.1   2515   2401   62  71
>>
>>
>>
>>
>>Further details at:
>>Détails additionnels chez:
>>Weitere Details unter:
>>
>>http://www.utzingerkurt.com



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.