Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: I don't think wmcc results is enough reliable, isn't it?

Author: Michael Fuhrmann

Date: 19:48:47 08/24/00

Go up one level in this thread


On August 24, 2000 at 22:01:39, Bruce Moreland wrote:

>On August 24, 2000 at 18:53:53, Eran wrote:
>
>>Different chess programs use different processor speed, and the results may not
>>be fair. If Junior uses Pentium III 1000 Mhz instead of 700 Mhz, Junior might be
>>a bit stronger and belong to the group of top chess programs, Shredder, Fritz,
>>and Nimzo. I assume that if all chess programs use the same processor speed
>>exactly, for instance Pentium III 1000 Mhz, the wmcc results will be enough
>>reliable and fair. Do you agree with it?
>>
>>Eran
>
>As for "fair", this is not a uniform platform tournament.  If you do a uniform
>platform tournament, you get "fair".  If you go to one that isn't, and you
>expect "fair", it's better to stay home, because it won't be.  It's not uniform
>platform.
>
>If you expect "reliable", even in a uniform platform tournament, you aren't
>going to get that, either.  If you deduce a perfectly accurate rating for each
>participant, and simulate the tournament a few dozen times, you'll get wildly
>different results.  The "best" program won't win every time.  The "best" program
>might not even finish in the top half.
>
>bruce


Sounds like there's no good reason for holding the event at all, since the
result doesn't tell us anything meaningful.




This page took 0.01 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.