Computer Chess Club Archives


Search

Terms

Messages

Subject: Little Test Suite Survey ?

Author: GeoffW

Date: 13:09:27 08/30/04


Hi

I have been working on some mods to my program recently, as usual I was
struggling a little trying to figure out the effects. I like to run a couple of
test suites to roughly prove whether the effect is positive or negative.

It got me thinking what other test suites, and test conditions people use to
test their mods. My criteria are

1) The test suite should run in less than 15 minutes. Not got enough patience I
know :-)

2) The tests should contain as many borderline Solves/Fails as possible for the
time used, to measure the effect of any changes.

Obviously the chosen test suite and parameters will vary with, the strength of
the engine being tested, and the speed of the PC

Here is what I have found is best for me

PC 2.2 GHz P4 using 64 Meg hash

LCT2.EPD 10 secs/position  = 19 solved  16 failed
small changes to my engine can make this easily go to 15 solved 20 Fails


IQ4.EPD 3 secs/position  = 108 solved  80 failed
just fixed a 1 line hash bug that made this previouly  94 solved 94 Fails


Data from other people would be interesting to compare ?



         Regards Geoff












This page took 0.01 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.