Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Test suite WM-Test : updated Excel sheet now with 230 tested engines

Author: George Tsavdaris

Date: 15:31:50 01/23/04

Go up one level in this thread


On January 23, 2004 at 13:23:29, Manfred Meiler wrote:

>Hello,
>
>at http://www.computerschach.de/test/index.htm there's an updated version of my
>Excel sheet with the detailed results of 230 engines (engine versions) in the
>test suite "Weltmeister-Test" (WM-Test).
>
>The "WM-Test" includes 100 test positions from games of the different (human)
>chess world champions: 38 positions in King attack, 36 positions in positional
>playing and 26 positions in endgame.
>
>Test conditions:
>Each of the 100 test positions was tested 20 minutes in analyse mode, without
>access to opening books, but with access to endgame databases (Nalimov
>tablebases, complete 3/4/5 pieces.
>My hardware: AMD Athlon Thunderbird 1400 MHz.
>
>Since my last published Excel sheet (2003 September, with 204 engines) the
>following engines (among others) were tested by me:
>
>- Shredder 8, Gambit Shredder 8
>- Deep Fritz 8, X3D Fritz, Fritz 8 WM-Edition (8.0.0.26)
>- Ruffian 2.0.0, Ruffian Leiden 2003
>- Rebel 12.00.01 (Windows)
>- CM9_Gladiator, CM9_Mapi
>- List 5.12-3 UCI
>- Aristarch 4.36
>- SOS.4 for Arena
>- El Chinito 3.25
>- Ktulu 4.2
>- SmarThink 0.17a
>- Delfi 4.4 usw.
>

Why you didn't test also Crafty 19.8 or 19.9 and you stopped at Crafty 19.03?

 Very strange indeed the differences between Fritz X3D and Deep Fritz 8.
In ~84% of positions there are equal times and depths. In ~12% X3D was better
and in the rest Deep Fritz 8 was better, but always with almost similar times
and depths. But in position 18 for example Deep Fritz 8 don't solve it at all
while Fritz X3D solves it rather quickly. In position 74 the opposite happens.
 So the only thing i can concude is that they don't differ only in non-SMP
support but also to some other small things. So i would like SSDF to test this
engine too to see if it's better or not from Deep Fritz 8.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.