Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Engine testing: Who do you play?

Author: Dan Honeycutt

Date: 08:09:16 08/28/04

Go up one level in this thread


On August 28, 2004 at 10:52:08, Stuart Cracraft wrote:

>On August 28, 2004 at 04:31:06, Volker Böhm wrote:
>
>>
>>I agree to the two earlier posts. Don´t test agains the older version of the
>>same engine. Usually you do not get good results.
>>
>>Test against some other engines. I suggest you select:
>>
>>1. One Engine that plays a very safe style
>>2. One Engine that plays a very positional style
>>3. One "Average" Engine
>>4. One Engine that outsearches you
>>5. One Engine that you are outsearching but that is not (much) weaker than
>>yourself
>>
>>Greetings Volker
>
>With this said, I would say that using previous versions to determine
>only if a new feature is better or worse, but not by how much, makes
>sense.
>

That's what I'm trying to do - determine (with some degree of confidence) if a
change is an improvement or not.  I don't really care how much and to determine
this, I would think, would require a lot more testing.

Dan H.

>Choose which features to then test further in other ways.
>
>Stuart



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.