Author: Vasik Rajlich
Date: 03:45:31 08/31/04
Go up one level in this thread
On August 30, 2004 at 21:55:51, Anthony Cozzie wrote: >On August 30, 2004 at 16:09:27, GeoffW wrote: > >>Hi >> >>I have been working on some mods to my program recently, as usual I was >>struggling a little trying to figure out the effects. I like to run a couple of >>test suites to roughly prove whether the effect is positive or negative. >> >>It got me thinking what other test suites, and test conditions people use to >>test their mods. My criteria are >> >>1) The test suite should run in less than 15 minutes. Not got enough patience I >>know :-) >> >>2) The tests should contain as many borderline Solves/Fails as possible for the >>time used, to measure the effect of any changes. >> >>Obviously the chosen test suite and parameters will vary with, the strength of >>the engine being tested, and the speed of the PC >> >>Here is what I have found is best for me >> >>PC 2.2 GHz P4 using 64 Meg hash >> >>LCT2.EPD 10 secs/position = 19 solved 16 failed >>small changes to my engine can make this easily go to 15 solved 20 Fails >> >> >>IQ4.EPD 3 secs/position = 108 solved 80 failed >>just fixed a 1 line hash bug that made this previouly 94 solved 94 Fails >> >> >>Data from other people would be interesting to compare ? >> >> >> >> Regards Geoff > >You use test suites? > >anthony IMO it's good to avoid the whole X solved, Y failed thing. The main value of test problems is to get ideas - then you have to make sure that these ideas don't have side-effects. Vas
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.