Computer Chess Club Archives


Search

Terms

Messages

Subject: Crafty test has ended and the winner is.... (stats+pgn download)

Author: Jonas Cohonas

Date: 09:44:12 02/12/02


You can download all 100 games here:
http://www.betachess.dk/Crafty v The best.zip

Example of Match setup: (except Shredder 6_Dual where games were ponder=off)
10 games
40/40+40/40+40
Dual MP 1600+ 256 Mb ram
Win2k

Crafty 17.14                   with: 64Mb hash
Junior 7                       with: 65Mb hash
C1714                          with: Fritz7.ctg
J7                             with: j7book.ctg

Ponder   =on
Booklearn=on
3+4+some 5 men tb's


This does not prove that one is stronger than the other, however it goes to show
that matching crafty's against eachother could be potentially misleading when
trying to find the strongest Crafty version.
These games are not by a long shot enough to conclude anything, but it seems to
indicate that when trying to find a strongest version, one should choose
different and strong(er) opponents in order to get a clearer picture.
This was a fun test to do, but if there is a need to test further i would like
for someone else to continue :)

Regards
Jonas


Program                        Elo    +   -   Games   Score   Av.Op.  Draws

1 Shredder 6_Dual            : 2708  135 165    20    72.5 %   2540   25.0 %
2 Junior 7                   : 2687  138 172    20    70.0 %   2540   20.0 %
3 Fritz 7 (No MMX)           : 2666  141 110    20    67.5 %   2540   45.0 %
4 Fritz 7b                   : 2628  149 107    20    62.5 %   2540   45.0 %
5 Gambit Tiger 2.0           : 2610  153 152    20    60.0 %   2540   20.0 %
6 Crafty 18.13               : 2544   92  82    50    34.0 %   2659   28.0 %
7 Crafty 17.14               : 2536   85  81    50    33.0 %   2659   34.0 %

Individual statistics:

(1) Shredder 6_Dual           :  20 (+ 12,=  5,-  3), 72.5 %

Crafty 18.13                  :  10 (+  6,=  2,-  2), 70.0 %
Crafty 17.14                  :  10 (+  6,=  3,-  1), 75.0 %


(2) Junior 7                  :  20 (+ 12,=  4,-  4), 70.0 %

Crafty 18.13                  :  10 (+  6,=  1,-  3), 65.0 %
Crafty 17.14                  :  10 (+  6,=  3,-  1), 75.0 %


(3) Fritz 7 (No MMX)          :  20 (+  9,=  9,-  2), 67.5 %

Crafty 18.13                  :  10 (+  5,=  5,-  0), 75.0 %
Crafty 17.14                  :  10 (+  4,=  4,-  2), 60.0 %


(4) Fritz 7b                  :  20 (+  8,=  9,-  3), 62.5 %

Crafty 18.13                  :  10 (+  2,=  5,-  3), 45.0 %
Crafty 17.14                  :  10 (+  6,=  4,-  0), 80.0 %


(5) Gambit Tiger 2.0          :  20 (+ 10,=  4,-  6), 60.0 %

Crafty 18.13                  :  10 (+  7,=  1,-  2), 75.0 %
Crafty 17.14                  :  10 (+  3,=  3,-  4), 45.0 %


(6) Crafty 18.13              :  50 (+ 10,= 14,- 26), 34.0 %

Shredder 6_Dual               :  10 (+  2,=  2,-  6), 30.0 %
Gambit Tiger 2.0              :  10 (+  2,=  1,-  7), 25.0 %
Fritz 7 (No MMX)              :  10 (+  0,=  5,-  5), 25.0 %
Junior 7                      :  10 (+  3,=  1,-  6), 35.0 %
Fritz 7b                      :  10 (+  3,=  5,-  2), 55.0 %


(7) Crafty 17.14              :  50 (+  8,= 17,- 25), 33.0 %

Shredder 6_Dual               :  10 (+  1,=  3,-  6), 25.0 %
Gambit Tiger 2.0              :  10 (+  4,=  3,-  3), 55.0 %
Fritz 7 (No MMX)              :  10 (+  2,=  4,-  4), 40.0 %
Junior 7                      :  10 (+  1,=  3,-  6), 25.0 %
Fritz 7b                      :  10 (+  0,=  4,-  6), 20.0 %

Games        :    100 (finished)

White Wins   :     40 (40.0 %)
Black Wins   :     29 (29.0 %)
Draws        :     31 (31.0 %)
Unfinished   :      0

White Perf.  : 55.5 %
Black Perf.  : 44.5 %

ECO A =      7 Games ( 7.0 %)
ECO B =     46 Games (46.0 %)
ECO C =      7 Games ( 7.0 %)
ECO D =     20 Games (20.0 %)
ECO E =     20 Games (20.0 %)





This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.