Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: If 75 Games are not considered a Statistical proof, neither is the SSDF.

Author: Peter Fendrich

Date: 16:44:49 01/30/01

Go up one level in this thread


On January 30, 2001 at 09:06:09, Jorge Pichard wrote:

>Ever since I matched Nimzo 8 vs Junior 6 using my AMD K6-2 500 MHz and also
>matched them using my Athlon 800 MHz at G\60 and got different scores; some
>people argued that those games were not statistically significants to proof
>anything at all. Then we must disregard the SSDF rating list, since each Chess
>program only play 40 games against each other and not 200 games.
>
I'm not sure of what you are trying to prove with your matches but if it's their
strength in general the problem is not at all the number of games. It's the low
number (2) of opponents. Suppose that Nimzo for some reason does better against
Junior than against others (or the other way around) then your results will bias
against that, regardless of how many games you play.
If you are trying to predict how games, with exactly the used PC:s, between
these two programs only will turn out, you have som good data.

>PS: I am still convinced that Nimzo 8 is one of the few programs just like
>Gandalf 4.32 that benefit the most by using the best hardware available. And
>they are not programmed specifically to outperform Fritz 6 on a particular
>hardware such as the AMD K6-2 450 MHz.

If this is what you are trying to prove then we have a different story that
shouldn't be compared to the SSDF tests at all.
//Peter




This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.