Author: Bruce Moreland
Date: 06:58:25 11/07/97
Go up one level in this thread
On November 07, 1997 at 05:17:25, Kai Lübke wrote: >Does that imply that it is _in general_ flawed to test two programs >against each other with PB off? (I do this quite often since I don't >always have two machines available) Yes. How well a program handles thinking on your time is one of the areas in which programs can differ in quality. You'll get results like this, but I think that if you try to report them in terms of "program A beat program B in a 10-game match", you should at least report that you did it on a single machine. There are other reasons to beware of single-machine testing. If you test with "10 seconds per move" or something like that, you should check to see that both programs are actually thinking for ten seconds per move. A better way would be to do "game in 15 minutes", or something like that, I think. Also, you should try to see if one program is impeding the other one. There should be no difference in node rate of either program when the other one is also booted. bruce
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.