Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: How accurate are the Winboard Programs Rating ?

Author: Jason Williamson

Date: 08:31:24 04/13/00

Go up one level in this thread


On April 13, 2000 at 09:47:46, Mogens Larsen wrote:

>On April 13, 2000 at 09:25:49, Jorge Pichard wrote:
>
>>I have seen different Websites and almost all have LG2000 2.5 rated second after
>>Crafty Fallowed by AnMon 5.6 as the third rated Winboard program. I agreed so
>>far with those rating, but last week I started to test the newer version of
>>Gromit 3.0 Versus Lg2000 2.5 and against AnMon 5.06.  Either the testers were
>>using a different processors than I was prodicing different result, or the
>>setting and opening book were different, I used an AMD K6 II 500 Mhz and the
>>result for Gromit 3.0 were much higher than either Lg2000 2.5 and AnMon 5.06.
>>The time for the first test was set to game in 15 minutes per side using
>>Winboard version 4.07 and the same computer with 128 Mb of RAM. Gromit Score
>>28.5 games out of 50 against Lg2000 2.5 and 31 to 19 against AnMon 5.06. Now I
>>was very upset simply because my favorite program Lg2000 2.5 lost to Gromit 3.0,
>>but when I tested against Anmont 5.06, I finally realized that Gromit was way
>>underated. Then I tested then once more increasing the time control to game
>>in 30 minutes per side, and again Gromit 30 score this time the test was shorter
>>only 30 games and Gromit score 16.5 out of 30 games against Lg2000 2.5 and
>>against AnMon 5.06 Gromit Score 18 to 12. Now what is wrong with this picture?
>>Gromit 3.0 clearly beat the crap out of the two leading programs in the Winboard
>>rating list. Why does Gromit has such a low rating on all Winboard Rating List?
>
>I agree that Gromit 3.0 is underrated, but it might be due to the lack of games.
>It's fairly new and I believe its rating will increase as time goes by.
>Furthermore you shouldn't put too much emphasis on the ratings. It's fairly
>certain that Crafty is the strongest WinBoard engine, but there's a lot of
>engines crowding the places behind Crafty. SOS, Comet (B20 looks strong), LG2000
>and maybe Gromit 3.0. In my experience AnMon belongs to this category at faster
>games, e.g. below a minute per move. I haven't tested Gromit 3.0 at longer
>timecontrols to check if the improvement is limited to rapid games. That would
>be an obvious thing to do.
>
>My strength list would be something like this:
>1. Crafty 2. LG2000 3. SOS 4. Comet, AnMon 5. Gromit, Phalanx, TCB and Amy.
>
>Best wishes...
>Mogens

Mine would be:

1. Crafty Out of intertia, I suspect that the gap is narrowing if you only use
one cpu.
2. LG2000
3. TCB
4. Comet
5. AnMon
6. Gromit
7. Amy Again using 1 cpu only
8. Phalanx

But I also put the gap between 8 and 1 first as less then 100 points, and
between 8 and 2 maybe less then 50-75. With SMP used, Crafty is quite far ahead,
then probably LG, then Amy, then the rest.  SOS appears to be ok, but I haven't
tested it enough to rank it yet.  :)

Jason



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.