Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: SSDF Rating Irregularities

Author: James T. Walker

Date: 13:12:09 12/10/99

Go up one level in this thread


On December 09, 1999 at 22:58:28, Robert Hyatt wrote:

>On December 09, 1999 at 22:11:00, Len Eisner wrote:
>
>>The older programs on the SSDF list are underrated and the newer ones are
>>overrated.  Why is that?
>>
>>Bob Hyatt's view is that the best of the current programs are about 2450.  That
>>is at least 200 points less than their SSDF ratings.
>>
>>The older programs seem to be underrated by about as much as the new ones are
>>overrated.  For example, the Fidelity Mach IV is only rated 2074 when it should
>>be over 2250.  The old Novag Super Constellation is only 1731.  I know it was at
>>least 200 points stronger than that.
>>
>>Len
>
>
>I don't think the mach iv was anywhere near 2250.  It was at action chess
>(game/30/game/60) but not 40/2
>
>What I think has happened is that newer programs blow older ones out, and
>artificially inflate the newer program ratings, and artificially deflate older
>program ratings...
>
>The older programs are not played against each other any longer, and the only
>way their ratings can go is down...


The fidelity Mach IV was officially rated by the USCF at 2325 after playing 40
games at tournament time controls.  It may not have been at 40/120 but was at
least 40/90 I'm not sure about the time controls.  In the same event the Mach 3
was rated 2265 which seems normal since it was about 1/2 the speed of the Mach4.
 This was fairly early in the Chess rating days and not many people had a lot of
experience with playing against computers and virtually nobody new anything
about anti-computer chess.  I'm sure it could not achieve that rating today but
even then it was generally considered that FIDE rating would be about 150-200
points lower than USCF.  I don't think the SSDF has ever claimed to be on par
with FIDE but close to the Sweedish ratings.  All test I have run with programs
seem to indicate your suspicions that the new programs inflate their ratings by
taking advantage of known weaknesses of the old programs.  This makes the
ratings of new programs higher than should be and lowers the ratings of older
ones.  Only my opinion based on my personal experience of course.
Jim Walker
Jim Walker



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.