Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Junior 9 : If it isn't a bug, that resembles to him much !

Author: Mark R. Anderson

Date: 13:58:03 12/17/04

Go up one level in this thread


On December 17, 2004 at 13:23:51, Thorsten Czub wrote:

>don't you think the chances to get 2nd rank were a little disadvantages due to
>the fact that you run SO MANY different Shredder programs ??
>
>IMO this way your tournament is not giving much significant data.
>
>ONE program Shredder8 would have been enough IMO.

Thorsten,

I agree ... that's what I dislike when people run big tournaments with *many*
versions of Chessmaster, for example.  It's fine to test many versions of a
program, but only *one* at a time per tournament please!  Otherwise, they are
giving a greater chance for one of the "variants" to get a statitically unlikely
result, and will end up thinking the program is stronger than it really is.

An example:  Say, hypothetically that Anand was going to play a match of the
Champion of India (him) versus the champion of Russia (Kasparov).  That's
*already* a daunting task, but what if he then also had to play Kramnik, Bareev,
Svidler, Dreev, Ivanchuk, etc ... all against him?  How would you feel as Anand
in that case?

That's what it's like when these people "gang up" versions of a program against
one program they are testing.  It seems that they *want* the tested program to
lose.  To me, Junior 9 faced a tough task with so many versions of top-ranking
programs all arrayed against it.  Despite that, Junior came in 2nd ... pretty
good, in my view!

Mark Anderson



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.