Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Little Test Suite Survey ?

Author: Anthony Cozzie

Date: 18:55:51 08/30/04

Go up one level in this thread


On August 30, 2004 at 16:09:27, GeoffW wrote:

>Hi
>
>I have been working on some mods to my program recently, as usual I was
>struggling a little trying to figure out the effects. I like to run a couple of
>test suites to roughly prove whether the effect is positive or negative.
>
>It got me thinking what other test suites, and test conditions people use to
>test their mods. My criteria are
>
>1) The test suite should run in less than 15 minutes. Not got enough patience I
>know :-)
>
>2) The tests should contain as many borderline Solves/Fails as possible for the
>time used, to measure the effect of any changes.
>
>Obviously the chosen test suite and parameters will vary with, the strength of
>the engine being tested, and the speed of the PC
>
>Here is what I have found is best for me
>
>PC 2.2 GHz P4 using 64 Meg hash
>
>LCT2.EPD 10 secs/position  = 19 solved  16 failed
>small changes to my engine can make this easily go to 15 solved 20 Fails
>
>
>IQ4.EPD 3 secs/position  = 108 solved  80 failed
>just fixed a 1 line hash bug that made this previouly  94 solved 94 Fails
>
>
>Data from other people would be interesting to compare ?
>
>
>
>         Regards Geoff

You use test suites?

anthony



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.