Computer Chess Club Archives


Search

Terms

Messages

Subject: Crafty 18.15 v 17.10

Author: Shaun Brewer

Date: 14:29:31 07/19/02


Crafty versions
I noticed on someones(I forget whos) tournament that 17.10 was placed higher
than 18.15 so I thought I would run my own tests. I was expecting to see this
was a statitical fluke. However at fast time controls (120+2 and 300+5) on a
modest PC (Tbird 850) 17.10 is stronger. A test at 900+15 is running with 17.10
ahead.
Can anybody point me at other comparisons between crafty version. I will soon be
starting opening book testing and I would like to be running with the
?strongest? version. Have changes in evaluation which perhaps suit human
opponents weekened crafty v programs?
I used the same broad book for both, generated in 18.15 and 17.10 respectively
to avoid any improvements there.
Results:

120+2:
Individual statistics:
(1) wcrafty-17.10 : 500 (+166,=246,- 88), 57.8 %
(2) Crafty-18.15 : 500 (+ 88,=246,-166), 42.2 %
Program Score % Av.Op. Elo + - Draws
1 wcrafty-17.10 : 289.0/500 57.8 2373 2427 27 19 49.2 %
2 Crafty-18.15 : 211.0/500 42.2 2427 2373 19 27 49.2 %

300+5:
Individual statistics:
(1) wcrafty-17.10 : 500 (+159,=231,-110), 54.9 %
(2) Crafty-18.15 : 500 (+110,=231,-159), 45.1 %
Program Score % Av.Op. Elo + - Draws
1 wcrafty-17.10 : 274.5/500 54.9 2383 2417 29 20 46.2 %
2 Crafty-18.15 : 225.5/500 45.1 2417 2383 20 29 46.2 %

900+15: (In progress)
wcrafty-17.10 +46,=39,-17 !!!
according to elsstat that makes 17.10 better than 18.15 99.7% confidence even at
this time control.
Has anyone else experienced similar?
I will try 1800+30 on my PIII perhaps 18.15 will pull ahead?

PGN available please ask - Dann I you should have received a bunch of games
sorry for the delay.
Shaun



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.