Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: None of these tests are truly scientific!

Author: Bruce Moreland

Date: 14:52:25 01/26/99

Go up one level in this thread



On January 26, 1999 at 16:25:17, KarinsDad wrote:

>I'm glad that you are running other programs against the control. At what times
>are you running the programs, on what type and speed processors, and what is
>your matching criteria?

One minute per move, you choose the processor, and a match is scored if you'd
play the move at the end of the minute.

I am flexible about the processor because I didn't want to split hairs over
whether a P5/133 is X% slower than a P6/200 or whatever.  I figured that a few
people might run this on Crafty uing different hardware, and that might make
show us what effect this had on match rate.

This is a little too multivariate to make a good controlled experiment, but
people will have reservations, possibly the same people, no matter what attempts
are made to control the experiment better.  I don't think it is possible to
control it perfectly, so if you try to do so, people will point out the flaws
anyway.

bruce



This page took 0.01 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.