Author: Shaun Brewer
Date: 07:43:55 07/03/02
I have been looking at some different binaries for crafty 18.15 - I was looking
for CPU optimized versions. I have run tests on the binaries I have found - see
at the end of this note.
A couple of questions have occurred to me:
Are there other sites that provide various optimized binaries?
Given there does seem to be a significant difference in performance of these
binaries do other programs have CPU optimized executables?
Results:
--------
Bench results:
Each bench was run three times and the best result taken - normally very little
difference but attempt to remove any discrepancy due to background tasks
Bench results on Athlon (TBird) 850mhz
wcrafty-18.15 - from Robert Hyatt’s ftp site
Total nodes: 97487547
Raw nodes per second: 451331
Total elapsed time: 216
SMP time-to-ply measurement: 2.962963
Crafty18-15 - from Dann Corbit’s ftp site
Total nodes: 97487547
Raw nodes per second: 480234
Total elapsed time: 203
SMP time-to-ply measurement: 3.152709
Crafty-1815 - from Dann Corbit’s ftp site
Total nodes: 111139080 - ??? different total nodes
Raw nodes per second: 479047
Total elapsed time: 232
SMP time-to-ply measurement: 2.758621
c1815-k7mmx - from ftp://speedycpu.dyndns.org/pub/crafty/
Total nodes: 111139080
Raw nodes per second: 479047
Total elapsed time: 232
SMP time-to-ply measurement: 2.758621
Bench results on PIII 1132mhz
wcrafty-18.15 - from Robert Hyatt’s ftp site
Total nodes: 97487547
Raw nodes per second: 590833
Total elapsed time: 165
SMP time-to-ply measurement: 3.878788
Crafty18-15 - from Dann Corbit’s ftp site
Total nodes: 97487547
Raw nodes per second: 617009
Total elapsed time: 158
SMP time-to-ply measurement: 4.050633
Crafty-1815 - from Dann Corbit’s ftp site
Total nodes: 111139080
Raw nodes per second: 614028
Total elapsed time: 181
SMP time-to-ply measurement: 3.535912
c1815-k7mmx - from ftp://speedycpu.dyndns.org/pub/crafty/
Total nodes: 111139080
Raw nodes per second: 669512
Total elapsed time: 166
SMP time-to-ply measurement: 3.855422
Match Results
-------------
Match results all on Athlon (TBird) 850mhz
All games 2min + 2sec - If anyone wants me to post PGN I can - or email:
Stats produced with elostat_11b base elo 2400 (I had to choose something)
wcrafty-18.15 v Crafty-1815
---------------------------
1st 100 games
Program Score % Av.Op. Elo + -
Draws
1 Crafty-1815 : 57.0/100 57.0 2376 2424 64 45
46.0 %
2 wcrafty-18.15 : 43.0/100 43.0 2424 2376 45 64
46.0 %
1st 200 games
Program Score % Av.Op. Elo + -
Draws
1 Crafty-1815 : 109.0/200 54.5 2384 2416 46 27
55.0 %
2 wcrafty-18.15 : 91.0/200 45.5 2416 2384 27 46
55.0 %
1st 300 games
Program Score % Av.Op. Elo + -
Draws
1 Crafty-1815 : 157.0/300 52.3 2392 2408 39 21
58.7 %
2 wcrafty-18.15 : 143.0/300 47.7 2408 2392 21 39
58.7 %
All 362 games
Program Elo + - Games Score Av.Op.
Draws
1 Crafty-1815 : 2406 36 19 362 51.7 % 2394 58.0
%
2 wcrafty-18.15 : 2394 19 36 362 48.3 % 2406 58.0
%
wcrafty-18.15 v Crafty18-15
---------------------------
1st 100 games
Program Score % Av.Op. Elo + -
Draws
1 Crafty18-15 : 55.0/100 55.0 2383 2417 65 34
62.0 %
2 wcrafty-18.15 : 45.0/100 45.0 2417 2383 34 65
62.0 %
1st 200 games
Program Score % Av.Op. Elo + -
Draws
1 Crafty18-15 : 108.5/200 54.2 2385 2415 46 26
57.5 %
2 wcrafty-18.15 : 91.5/200 45.8 2415 2385 26 46
57.5 %
1st 300 games
Program Score % Av.Op. Elo + -
Draws
1 Crafty18-15 : 159.0/300 53.0 2390 2410 38 20
59.3 %
2 wcrafty-18.15 : 141.0/300 47.0 2410 2390 20 38
59.3 %
All 360 games
Program Score % Av.Op. Elo + -
Draws
1 Crafty18-15 : 189.5/360 52.6 2391 2409 35 18
61.4 %
2 wcrafty-18.15 : 170.5/360 47.4 2409 2391 18 35
61.4 %
Rating difference appears to drop over time due to learning?
Crafty18-15 v Crafty-1815
to follow
wcrafty-18.15 v c1815-k7mmx
to follow
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.