Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Yace 0.99.56 still the strongest amateur engine!? (Crafty 9.)

Author: Uri Blass

Date: 13:52:21 09/05/02

Go up one level in this thread


On September 05, 2002 at 15:47:24, Dann Corbit wrote:

>On September 05, 2002 at 08:26:56, pavel wrote:
>>On September 05, 2002 at 07:35:12, David Rasmussen wrote:
>>>I don't know how reliable this tournament is. Chezzz is consistently better on
>>>ICC against a number of the opponents that are above it in this tournament.
>>>
>>>/David
>>
>>
>>No offense to SSDF, but I consider this tournament to be more reliable than
>>SSDF.
>>If you look at the format of the tournament and the rules, and the way they are
>>being played out.
>>
>>Only handicap is that, not alot of games are played by each programs in each
>>division.
>>But it's still better than differant programs playing "differant numbers of
>>games" in a rating list.
>
>I don't see a problem with that approach, as long as enough games are played.
>When the number of games for some program is small, then the error bars will be
>large.

I can explain what is the problem.

Suppose that A get 60% against B,B get 60% agianst C and C get 60% agianst A.

The rating of the programs is based on the number of games that you play between
them and if you do not play equal number of games between every pair you may get
that A is significantly better than C after enough games.

Uri



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.