Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: None of these tests are truly scientific!

Author: Bruce Moreland

Date: 14:52:25 01/26/99

Go up one level in this thread



On January 26, 1999 at 16:25:17, KarinsDad wrote:

>I'm glad that you are running other programs against the control. At what times
>are you running the programs, on what type and speed processors, and what is
>your matching criteria?

One minute per move, you choose the processor, and a match is scored if you'd
play the move at the end of the minute.

I am flexible about the processor because I didn't want to split hairs over
whether a P5/133 is X% slower than a P6/200 or whatever.  I figured that a few
people might run this on Crafty uing different hardware, and that might make
show us what effect this had on match rate.

This is a little too multivariate to make a good controlled experiment, but
people will have reservations, possibly the same people, no matter what attempts
are made to control the experiment better.  I don't think it is possible to
control it perfectly, so if you try to do so, people will point out the flaws
anyway.

bruce



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.