Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: If 75 Games are not considered a Statistical proof, neither is the SSDF.

Author: Uri Blass

Date: 06:56:15 01/30/01

Go up one level in this thread


On January 30, 2001 at 09:06:09, Jorge Pichard wrote:

>Ever since I matched Nimzo 8 vs Junior 6 using my AMD K6-2 500 MHz and also
>matched them using my Athlon 800 MHz at G\60 and got different scores; some
>people argued that those games were not statistically significants to proof
>anything at all. Then we must disregard the SSDF rating list, since each Chess
>program only play 40 games against each other and not 200 games.
>
>PS: I am still convinced that Nimzo 8 is one of the few programs just like
>Gandalf 4.32 that benefit the most by using the best hardware available. And
>they are not programmed specifically to outperform Fritz 6 on a particular
>hardware such as the AMD K6-2 450 MHz.

I think that the problem with your experiment is that you did not compare 2
hours/40 moves on K6-2 500 mhz with 2 hours/40 moves on athlon 800.

If you want to claim that nimzo earns more from time than Junior then the right
experiment is to use the same hardware at different time control.

If you want to claim that nimzo earns more from the new architecture of the
athlon then the most simple experiment is to compare nodes per second.

The time control that you used(1 hour/game) is more than twice faster than the
ssdf games(2 hours/40 moves+1 hour/20 moves)

The athlon800 compensates probably only for part of the difference so your games
are still faster than the ssdf games and if nimzo8 on athlon800 can win Junior6
at 1 hour/game when it cannot do it in the ssdf games then the only possible
reason that I see is if nimzo earns more from the architecture of the athlon.

Another problem is that it is possible that nimzo8 wins against Junior at 1 hour
per game lose against Junior at blitz and again win against Juniot st 1
hour/move.

I do not think that you can get conclusion about longer time control that you
did not try.

I remember that nimzo7.32 did a big positional error against Steve Ham in a
correspondence game when other programs have no problem to avoid the error in
some minutes and it leads me to suspect that nimzo does not continue to earn
more from time when you go to longer time control.

Uri



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.