Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: CM9000 Testing finished !

Author: Kurt Utzinger

Date: 05:16:30 03/27/05

Go up one level in this thread


On March 27, 2005 at 07:03:54, Ray Banks wrote:

>I'm calling it quits on CM9000 testing and moving on to CM10th, rather later
>than most.
>
>My testing was as follows:
>
>Deep Fritz 8 GUI
>40 moves in 40 min repeating, 256MB Hash
>Dual Athlon MP2800+ with ponder on
>3-4-5 men EGTB
>All engines using 2004 Powerbook
>no learning
>
>Each CM9000 personality played 40 games against each of:
>Deep Shredder 8
>Deep Fritz 8
>Deep Junior 8
>Chess Tiger 15
>Hiarcs 9
>Ruffian 2.1.0
>Gandalf 6.0
>
>That is 280 games for each personality, and 2,240 games in total. The aggregate
>scores out of 280, and rankings, were:
>
>144.0 - Slayer
>141.5 - Assassin
>139.0 - R1
>139.0 - Slayer 2b
>136.5 - T05
>136.0 - Judge II
>135.0 - Minotaur 2
>130.0 - Alliance
>
>After all that, I'm not certain how conclusive the results are - clearly there
>is a difference between Alliance at the bottom, and Slayer at the top. But in
>between, the 135.0 - 139.0 range is probably too close to call and they are
>probably fairly equal in strength. At this time control under these conditions
>that is...

      Hi Ray
      How small the differences are can even be better seen
      if you also compare the scores of the individual engines:

      51.42 % or 144.0/280 - Slayer
      50.53 % or 141.5/280 - Assassin
      49.64 % or 139.0/280 - R1
      49.64 % or 139.0/280 - Slayer 2b
      48.75 % or 136.5/280 - T05
      48.57 % or 136.0/280 - Judge II
      48.21 % or 135.0/280 - Minotaur 2
      46.42 % or 130.0/280 - Alliance

      It's just crazy: so much work but we are still be unable
      to say for sure which is the best setting. Anyway many
      thanks for this test. Would you please be kind enough
      to send me the games as PGN.
      Kind regards
      Kurt [http://www.utzingerk.com]



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.