Author: Per Jørgensen
Date: 04:07:26 02/08/06
Hello Chesscomputerfriends!
A couple of weeks ago I had to give up my latest engine-ratinglist. It appeared
that the thinkingtime (40 moves in 14 minutes repeatedly) were simply too long,
especially when you yourself are the only tester. Consequently I decided to
start a new testserie with a shorter thinkingtime. I also decided to continue to
use fixed openingpositions in stead of the openingsbooks of each engine (or a
common book for all engines). Here are the 10 fixed openingpositions I am using
for my tests:
1. Queens Gambit: 1.d4, d5 2.c4
2. Kings Gambit: 1.e4, e5 2. f4
3. Stonewall: 1.d4, e6 2.c4, f5 3.Sc3, d5 4.Sf3, c6
4. Caro Kann: 1.e4, c6 2.d4, d5
5. English: 1.c4, c5 2.Sc3, Sc6
6. Russian: 1.e4, e5 2. Sf3, Sf6
7. King- or Grünfeldindian: 1.d4, Sf6 2.c4, g6 3.Sc3
8. Sicilian: 1.e4, c5 2.Sf3, d6 3.d4, cxd4
9. Queens indian: 1.d4, Sf6 2.c4, e6 3. Sf3, b6 4. g3, Lb7 5. Lg2, Le7
10. French: 1.e4, e6 2.d4, d5
Every engine has got to play each openingposition with both white and black
meaning that a match between 2 engines consists of 20 games. I find that the
chosen fixed openingpositions provide a fair mix of open, tactical and closed
positional openings. I would like to thank Klaus Wlotzka (running the
CSS-Ratinglist) for support and advices in the whole process.
I'm running my tests on this Hardware:
Asus A8V Motherboard, Socket 939, FSB 1.000 MHz
AMD Athlon 64 4000+, 2.4 GHz, 1 MB Level 2 Cache, 90 nm San Diego Core
2 x 512 MB Corsair PC 3200XLPT RAM (CAS Latency 2-2-2-5)
And here are the specific testconditions:
Windows XP Pro
Hiarcs 10 GUI
10 fixed openingpositions, all openingbooks for the engines are OFF
Thinkingtime for each engine: 6 min. for the whole game + 6 bonussec. pr. move
Hash Tables for each engine: 64 MB PC 3200 Ram (CAS Latency 2-2-2-5)
8 MB Cache for TB's
TB's: Nalimov - 3 und 4-pieces
Pondern OFF
In the last 4 weeks I have been running tests for my new ratinglist and today I
publish the first one:
<tt><pcode>
Program Elo + - Games Score Av.Op.
Draws
1 Fruit 2.2.1 : 2750 42 41 200 63.0 % 2658 29.0
%
2 Hiarcs 10 : 2745 42 42 200 62.3 % 2658 26.5
%
3 Toga II 1.1a : 2732 41 40 200 60.2 % 2660 31.5
%
4 Shredder 9 : 2722 41 41 200 58.8 % 2661 29.5
%
5 Fritz 9 : 2720 41 41 200 58.5 % 2661 29.0
%
6 SmarThink 1.00 : 2658 40 40 200 48.8 % 2667 32.5
%
7 Ktulu 7.5 : 2641 42 42 200 46.0 % 2669 25.0
%
8 Loop List 600 : 2604 43 43 200 40.2 % 2672 23.5
%
9 Naum 1.91 : 2602 39 39 200 40.0 % 2672 35.0
%
10 Glaurung 1.0.1 : 2585 44 44 200 37.5 % 2674 21.0
%
11 Ruffian 2.1.0 : 2567 41 42 200 34.8 % 2676 29.5
%
</pcode></tt>
All engines are playing with their default-settings with one exception: Hiarcs
10 is playing with Hypermodern ON.
It's my aim to make a ratinglist of 25 engines. As soon as Rybka 1.2 is
available I'll test that extraordinary engine and the same goes for updated
versions of Shredder, Fruit etc. Ofcourse I'll also test engines like The King
3.33, Pro Deo 1.1, Junior 9 and many more.
This morning I started the test of Spike 1.1. I'm excited to see the performance
of the this new version of Spike. In about 4 days the test will be ended and
then I'll publish results and a new updated ratinglist here in this forum.
Best regards
Per
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.