Author: Jorge Pichard
Date: 05:27:01 06/11/02
Go up one level in this thread
On June 11, 2002 at 07:37:52, Peter McKenzie wrote: >On June 11, 2002 at 06:30:43, Jorge Pichard wrote: > >>I left my computer on at G/10 and found out just now that Crafty was winning >>22.5 to 13.5 Now after seeing this difference do you still think that I need >>several hundred games to know which one is the best out of these two? >> >>Jorge > >Ask yourself this question: > >"If I ran this very same match 100 times, but with Crafty 18.15 vs Crafty 18.15, >then how many times would I see this score (22.5 - 13.5)?" > >What answer do you come up with? You can run any program against itself 30 times or 1000 times and the difference would never be more than 30%. It doesn't matter how many times you let a match run up to, if the difference is over a margin of 30%, then you should stop it. Jorge Jorge.
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.