Author: Sune Fischer
Date: 17:14:15 03/26/04
Go up one level in this thread
On March 26, 2004 at 04:54:57, Uri Blass wrote: >On March 24, 2004 at 17:31:35, Dann Corbit wrote: > >>On March 24, 2004 at 16:53:08, Uri Blass wrote: >>[snip] >>>The difference is more important and 10-0 is clearly more telling than 19-11 >> >>It is stronger, but less reliable. > >No 10-0 is clearly more reliable than 19-11 The interesting question is if 10-0 is more "reliable" than 20-10, and it isn't. One can prove that draws are not important if one is only interested in knowing which one is better. Note this is not to be confused with the question of how much difference in strength there is. It's two very different questions. >It usually will not happen but it does not mean that it is less reliable when >it >happens(you may suspect that something in the conditions is wrong when you see >10-0 but if you see that no program was significantly slower in nps during the >match than you can safely stop the match after 10-0 and say that the new program >is better). If I suspect something might be wrong I will stop the match and investigate, but one can easily imagine 10-0 or similar under proper conditions. In fact yesterday I played a match where the score after 15 games was 13.5-1.5 in favor of the new version. It actually ended up losing the match by 49-51 :( Honestly I do not remember having seen such a drastic score difference before, but I do regularly see a sequence of 6-8 straight wins by one of the engines in 100 game match, so it's not impossible to imagine this might occur at the beginning of the match. -S.
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.