Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: SSDF Rating List 2004-02-25

Author: George Tsavdaris

Date: 15:29:16 02/25/04

Go up one level in this thread


On February 25, 2004 at 17:04:11, Thoralf Karlsson wrote:

A big thanks to all of you, for the list.


>  20 Ruffian 1.0.1  256MB Athlon 1200 MHz    2678   29   -29   565   53%  2657
>  31 Ruffian 2.0.0  256MB  Athlon 1200 MHz   2611   57   -57   151   48%  2628

Really impressive this! I just can't believe it. Is Ruffian 2.0 so unlucky in
it's games or .....

>
>Ubi Soft claims that Chessmaster is "The World's Most Popular
>Chess Program"! I don't know if that is correct or not, but it
>could be, in some sense. Among the testers of SSDF though, the
>Chessmaster programs are certainly not the most popular in the
>sense frequently tested. Why is it so? With all other commercially
>available chess programs that we have come across for many years, it's
>easily possible to play long series of games against other programs
>automatically, 24 hours a day. But not with Chessmaster!
>
>Well, it's possible to do it with another programs interface, opening
>book and learning function, but we eventually came to the conclusion that
>this method wasn't fair...

 Fair? It would not be fair if you have been paid to make a test for the program
strength, that will include only chess programs as they are out of their box.
 So if you use some components of one program to another, your boss would be
disappointed as you didn't made a fair test as he only want to find the strength
of the programs as they are given and not combining features between them. But
that's not the case. You are not doing this for money and you are free to do
whatever you want. Is the purpose of the list to give the strength
of the engines or of the whole commercial package?
 I would hope, SSDF's purpose would be to test engines strength. So if
Chessmaster 9000 is able to play stronger when using a different book and
different settings and a different GUI, what is the reason not to test it?
 Fairness to who? Why you don't give us and you, the ability to see how
CM9000-SKR would do? Of course it's your choise but i definitely disagree.
 If for example Hiarcs 9 with some settings and Shredder's 8 book, would be
180 points stronger, then why we should not test it?


>Instead some of us have managed to play one game
>at a time automatically with Chessmaster 9000 Athlon 1200 MHz, using
>winboard232. After 376 games Johan de Konings program has received
>a rating of 2718! That is roughly 120 points more than the estimated
>rating of CM8000 on the same hardware!!
>
>When testing CM9000 we have used the original program (version 1.0.0),
>under it's original interface with it's own opening book, which doesn't
>have any learning function. The hashtables have been set to 64MB.
>
>Another new entrant from a computer chess veteran is Ed Schröders Rebel 12
>Athlon 1200 MHz. This Windows(!)-program is running under the Chess Partner-
>interface and has the version number 12.00.01. After 382 games it has a
>rating of 2691, which is 17 points more than Rebel Century 4.0 has.
>
>A completely new entry on the SSDF Rating list is Deep Sjeng 1.5a Athlon
>1200 MHz, also running under the Chess Partner interface. The program is
>written by Gian-Carlo Pascutto and the opening book is made by Jeroen Noomen.
>Deep Sjeng supports up to eight processors. When tested on one it's rating
>is 2670!
>
>About a year ago Ruffian 1.0.1 entered the rating list as the strongest freeware
>program. Now Per-Ola Valfridssons program has become commercially available,
>running under the Arena Chess GUI written by Martin Blume and with an opening
>book from Djordje Vidanovic. After 151 games Ruffian 2.0.0 A1200 has 2611, which
>is 67 points less than version 1.0.1 has. February 24 two new versions of
>Ruffian 2 became available, and we will play with either of them instead,
>hopefully with better results than with version 2.0.0.
>
>Nowadays very few new chess computers are included in the SSDF rating list.
>Thanks to Schach Niggemann we've got the possibility to test Novag's Star
>Sapphire, written by Dave Kittinger. After 103 games Star Sapphire's rating is
>2029, 21 point more than it's predecessor Sapphire II has.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.