Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: SSDF Rating List 2004-02-25

Author: Barry Baker

Date: 18:17:12 02/25/04

Go up one level in this thread


I'm trying to understand how to interpet the SSDF Rating List and have a few
questions.  I'm a CCC newbie so I'll apologize in advance if my questions
indicate a complete ignorance of rating calculations or statistics.

Has anybody analyzed the variability of a given engine's rating over a period of
time?  If you look at the THE SSDF RATING LIST at random time intervals, does
each rating or ranking change significantly?  The reason I ask is that I just
looked at the rating of "crafty" on ICC.  Its blitz rating was 2817.  During its
last twenty games, the range was 2798-2860 (a 62 point interval).  If I limit
the range to the most popular time control during the last twenty games (5 3),
the range was 2798-2858 (a 60 point interval).  Opponents in 5 3 games were
rated 2446-2816.  Crafty's rating seemed to vary widely for such a limited
number of games.

I don't know how ICC's rating formula varies from the formula for SSDF but do
similar fluctuations occur in SSDF?  Does an engine's rating take into account
the engine's variation in performance over time (i.e. if two engines have the
same average performance but one has a wider performance variation, will they
have the same rating)?  To be statistically significant, how much does the
difference in rating between two engines have to be in order to state that one
is stronger than the other?

Barry Baker



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.