Author: Per Jørgensen
Date: 10:36:54 03/05/06
Hello Chesscomputerfriends!
As I wrote in this Forum at several occasions I'm making a new ratinglist. I am
using fixed openingpositions in stead of the openingsbooks of each engine
(or a common book for all engines). Here are the 10 fixed openingpositions I am
using for my tests:
1. Queens Gambit: 1.d4, d5 2.c4
2. Kings Gambit: 1.e4, e5 2. f4
3. Stonewall: 1.d4, e6 2.c4, f5 3.Sc3, d5 4.Sf3, c6
4. Caro Kann: 1.e4, c6 2.d4, d5
5. English: 1.c4, c5 2.Sc3, Sc6
6. Russian: 1.e4, e5 2. Sf3, Sf6
7. King- or Grünfeldindian: 1.d4, Sf6 2.c4, g6 3.Sc3
8. Sicilian: 1.e4, c5 2.Sf3, d6 3.d4, cxd4
9. Queens indian: 1.d4, Sf6 2.c4, e6 3. Sf3, b6 4. g3, Lb7 5. Lg2, Le7
10. French: 1.e4, e6 2.d4, d5
Every engine has got to play each openingposition with both white and black
meaning that a match between 2 engines consists of 20 games. I find that the
chosen fixed openingpositions provide a fair mix of open, tactical and closed
positional openings. I would like to thank Klaus Wlotzka (running the
CSS-Ratinglist) for support and advices in the whole process. It's my aim to
create a ratinglist of 25 top-engines.
I'm running my tests on this Hardware:
Asus A8V Motherboard, Socket 939, FSB 1.000 MHz
AMD Athlon 64 4000+, 2.4 GHz, 1 MB Level 2 Cache, 90 nm San Diego Core
2 x 512 MB Corsair PC 3200XLPT RAM (CAS Latency 2-2-2-5)
And here are the specific testconditions:
Windows XP Pro
Hiarcs 10 GUI
10 fixed openingpositions, all openingbooks for the engines are OFF
Thinkingtime for each engine: 6 min. for the whole game + 6 bonussec. pr. move
Hash Tables for each engine: 64 MB PC 3200 Ram (CAS Latency 2-2-2-5)
8 MB Cache for TB's
TB's: Nalimov - 3 und 4-pieces
Pondern OFF
Lately I have been testing Junior 9 (version 3). Here are the testresults for
Junior:
Junior 9 - Hiarcs 10 4-16
Junior 9 - Fruit 2.2.1 4-16
Junior 9 - Toga II 1.1a 4-16
Junior 9 - Fritz 9 8½-11½
Junior 9 - Shredder 9 7-13
Junior 9 - Spike 1.1 7½-12½
Junior 9 - The King 3.33 6-14
Junior 9 - SmarThink 1.00 9½-10½
Junior 9 - Ktulu 7.5 10-10
Junior 9 - Pro Deo 1.1 8½-11½
Junior 9 - Loop List 600 12½-7½
Junior 9 - Gandalf 6.0 10½-9½
Junior 9 - Naum 1.91 11½-8½
Junior 9 - Glaurung 1.0.1 11½-8½
Junior 9 - Ruffian 2.1.0 9½-10½
The general performance of Junior 9 was quite disappoiting. I was expecting a
score around 45% but in the end only 41,5% was achieved. As a result of the
latest testresults the ratinglist now looks like this:
Program Elo + - Games Score Av.Op. Draws
1 Hiarcs 10 2770 35 35 300 65.0 % 2662 26.7 %
2 Fruit 2.2.1 2768 34 34 300 64.8 % 2662 29.0 %
3 Toga II 1.1a 2754 33 33 300 62.8 % 2663 32.3 %
4 Shredder 9 2728 34 34 300 59.0 % 2665 27.3 %
5 Fritz 9 2726 34 34 300 58.7 % 2665 27.3 %
6 Spike 1.1 2709 33 33 300 56.2 % 2666 32.3 %
7 The King 3.33 2673 33 33 300 50.7 % 2668 30.7 %
8 SmarThink 1.00 2659 33 33 300 48.5 % 2669 30.3 %
9 Ktulu 7.5 2655 34 34 300 47.8 % 2670 25.0 %
10 Pro Deo 1.1 2634 34 34 300 44.7 % 2671 25.3 %
11 Gandalf 6.0 2614 33 33 300 41.7 % 2672 30.0 %
12 Junior 9 2613 35 35 300 41.5 % 2672 23.7 %
13 Loop List 600 2609 35 35 300 41.0 % 2673 22.0 %
14 Naum 1.91 2606 32 32 300 40.5 % 2673 33.7 %
15 Glaurung 1.0.1 2597 35 35 300 39.2 % 2674 23.0 %
16 Ruffian 2.1.0 2589 33 33 300 38.0 % 2674 30.7 %
All engines are playing with their default-settings with exception of Hiarcs 10
which is being tested with Hypermodern ON.
As you see Hiarcs 10 mangaged to defend its topposition but it is still very
very close between Hiarcs 10 and Fruit 2.2.1. The King 3.33 has been doing very
fine in my tests and after another fine victory (14-6) against Junior 9 The King
3.33 has made a gab to SmarThink and Ktulu. Junior 9 only managed the 12th
position.
As soon as Rybka 1.1 is available I will naturally test this extraordinary
engine but in the meantime I'll make another test for my ratinglist. Next engine
to be tested is Chess Tiger 15.0
Best regards
Per
This page took 0.01 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.