Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: I don't think wmcc results is enough reliable, isn't it?

Author: Bruce Moreland

Date: 19:01:39 08/24/00

Go up one level in this thread


On August 24, 2000 at 18:53:53, Eran wrote:

>Different chess programs use different processor speed, and the results may not
>be fair. If Junior uses Pentium III 1000 Mhz instead of 700 Mhz, Junior might be
>a bit stronger and belong to the group of top chess programs, Shredder, Fritz,
>and Nimzo. I assume that if all chess programs use the same processor speed
>exactly, for instance Pentium III 1000 Mhz, the wmcc results will be enough
>reliable and fair. Do you agree with it?
>
>Eran

As for "fair", this is not a uniform platform tournament.  If you do a uniform
platform tournament, you get "fair".  If you go to one that isn't, and you
expect "fair", it's better to stay home, because it won't be.  It's not uniform
platform.

If you expect "reliable", even in a uniform platform tournament, you aren't
going to get that, either.  If you deduce a perfectly accurate rating for each
participant, and simulate the tournament a few dozen times, you'll get wildly
different results.  The "best" program won't win every time.  The "best" program
might not even finish in the top half.

bruce



This page took 0.01 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.