Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Results of 112 engines in test suite "WM-Test" (100 pos) for download

Author: Uri Blass

Date: 14:25:43 08/20/02

Go up one level in this thread


On August 20, 2002 at 14:53:31, Jorge wrote:

>On August 20, 2002 at 14:48:25, Jorge wrote:
>
>>On August 19, 2002 at 10:25:02, Roy Eassa wrote:
>>
>>>On August 16, 2002 at 15:05:50, Manfred Meiler wrote:
>>>
>>>>Hello,
>>>>
>>>>the test suite "Weltmeister-Test" (WM-Test) of the authors Dr. Michael Gurevich
>>>>and Heinz-Josef Schumacher finally includes now 100 test positions all out of
>>>>games of the World Chess Champions: 38 positions in king attack, 36 in
>>>>positional play and 26 in endgame.
>>>>
>>>>I've tested 112 engines in this test suite - also all new ones like Deep Fritz
>>>>7, Hiarcs 8, Rebel XP (DOS), Fritz 7,0,0,8, Aristarch 4.4, Tao 5.4, Pepito 1.55
>>>>...
>>>>My hardware: AMD Athlon Thunderbird 1400 MHz, 384 MB DDR-RAM.
>>>>Each of the 100 positions was tested 20 minutes in analyse mode, without opening
>>>>books but with access to Nalimov EGDB (5men).
>>>>
>>>>My detailed results are presented in an EXCEL sheet which is available for free
>>>>download at
>>>>
>>>>http://www.computerschach.de/test/
>>>>
>>>>Added is also a collection of the 100 test positions (commented) in the formats
>>>>cbh, cbf, pgn and epd.
>>>>The EXCEL sheet and the test positions are available in german and english
>>>>versions.
>>>>
>>>>Best regards,
>>>>
>>>>Manfred
>>>
>>>
>>>Incredible job!  Thanks!!  (BTW, I think your English is very good.)
>>>
>>>Here are the summary rankings for the top 40, aligned with spaces:
>>>
>>>rank program            version                 hash ELO
>>>                                                (MB)
>>> 01  Fritz 7d           (7,0,0,8) eng 19.05.02   256 2698
>>> 02  Fritz 7c           (7,0,0,6) eng 11.01.02   256 2698
>>> 03  Deep Fritz 7       eng 04.08.02             256 2696
>>> 04  Fritz 7b           (7,0,0,6) eng 07.01.02   256 2692
>>> 05  Fritz 7a           (7,0,0,2) eng 05.11.01   256 2681
>>> 06  CM 8000            Pillen exe 05.07.01      256 2680
>>> 07  Gambit Tiger 2.0   aggressiv dll 21.03.01   192 2679
>>> 08  CM 8000            Pillen exe 05.07.01       32 2676
>>> 09  CM 8000            HudetzXp 3 exe 05.07.01  128 2673
>>> 10  Gromit 3.9.5 (CB)  dll 18.08.01             284 2672
>>> 11  Fritz 7            (7,0,0,1) eng 13.10.01   256 2671
>>> 12  CM 8000            Schüle exe 05.07.01      256 2670
>>> 13  Gambit Tiger 1.0   default dll 13.11.00     192 2670
>>> 14  CM 8000            Sonnabend exe 05.07.01   128 2669
>>> 15  Junior 7           dll 29.05.01             255 2667
>>> 16  CM 8999            Brann exe 05.07.01       128 2666
>>> 17  Gandalf 5.1        dll 09.02.02             200 2665
>>> 18  Deep Fritz 6       eng 13.11.00             256 2665
>>> 19  Deep Junior 7      dll 29.05.01             255 2660
>>> 20  Gambit Shredder    6.02 (UCI) exe 05.03.02  256 2658
>>> 21  Gambit Tiger 2.0   normal dll 21.03.01      192 2658
>>> 22  Fritz 6c           eng 20.04.01             256 2657
>>> 23  CM 8000            Grailmaster2 05.07.01    128 2657
>>> 24  Fritz 6a           eng 09.04.00             256 2657
>>> 25  CM 8777            Kleinert exe 05.07.01     64 2654
>>> 26  Goliath Light 2.0  ß1.9c8 dll 04.03.01      256 2653
>>> 27  Gandalf 4.32h      (UCI) exe 22.04.01       104 2652
>>> 28  TB Shredder 6.02/Gandalf 5.1 TripleB    128/104 2651
>>> 29  Gandalf 5.0        dll 30.09.01             200 2650
>>> 30  Rebel XP (DOS)     eng 17.07.02             200 2650
>>> 31  Shredder PB/6.02   default exe 05.03.02     256 2646
>>> 32  Chess Tiger 14.0  (CB) dll 21.03.01         192 2646
>>> 33  Hiarcs 8           dll 15.04.02             256 2644
>>> 34  Fritz 7 (NoMMX)    eng 13.10.01             256 2644
>>> 35  Goliath Light 1.5  dll 14.07.01             256 2644
>>> 36  Chess Academy 6.0  midgame exe~12/2000      200 2643
>>> 37  Shredder 4         exe 10.11.99          192/32 2643
>>> 38  Shredder 6 Classic (UCI) exe 27.11.01       256 2643
>>> 39  Gandalf 4.32f exe  17.10.00                 104 2642
>>> 40  Fritz 5.32         eng 19.08.00             248 2641
>>
>>
>>Very well done indeed! Just an observation, but I do not see ChessTiger 14 on
>>the list, which probably is seeded pretty close to GT2 aggr.
>>
>>regrds,
>>jorge
>
>I see it now, but i'm surprised it scored that low.  I am curious if CP gui
>would have scored differently.

No reason to be surprised.
This test was designed to put Fritz on top because the analysis was done by
Fritz to decide about the positions.

I am sure that Fritz is going to have bad result if someone design a test to put
tiger on top.

Uri



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.