Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: A proposed WAC replacement for testing

Author: Andrew Williams

Date: 15:23:26 09/18/01

Go up one level in this thread


On September 18, 2001 at 13:05:08, Gian-Carlo Pascutto wrote:

>Like many others here, I use a standard testset
>for testing improvements and doing regression
>testing to my engine.
>
>So far WAC has been adequate, but as you all
>know it has two annoying problems, namely that
>over 2/3 of the problems are solved by 2 ply
>searches and hence useless, and the level of
>most of the others isn't very hard either with
>nowadays CPU's.
>
>ECM could have been better, but it's very big
>(over 800 positions) and contains a lot of garbage.
>
>Based on some parts of ECM I got from Dann's
>ftp and a day with Goliath Light, Hiarcs and
>my common sense I filtered 200 positions of
>varying difficulty which have, as far as I could
>tell and verify, correct solutions.
>The suite is meant for relatively quick testing
>of improvements and/or regressions. The recommended
>time is 10 seconds per position. Running all
>positions takes a little over half an hour. It
>is what I currently use instead of WAC.
>
>I would appreciate feedback about the positions,
>especially if you think there is an incorrect
>or dual soltion. Performance data of other amateur
>or professional programs is appreciated too.
>My latest Sjeng gets 80/200 at 10s on an Athlon 1000.
>
>GCP

Hmmm.. is it just me, or are there *201* positions?
PostModernist gets 84 at 10s on an Athlon 1200.
FYI, PM gets 59 at 5 seconds, and 26 at 1 second
Quite a nice distribution at short times. I'll try
overnight on 120 seconds.

Regards

Andrew

[Test positions snipped; please see GCP's original message for the test set]



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.