Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Best testsuite (sure it's not WAC)

Author: Dann Corbit

Date: 10:56:48 06/07/01

Go up one level in this thread


On June 07, 2001 at 10:52:03, Robert Hyatt wrote:

>On June 07, 2001 at 05:52:51, Jouni Uski wrote:
>
>>Yes I know all test suites are almost useless to finds the best playing chess
>>software. But still, which suite is the less bad in your opinion? If You can
>>only use one test suite before starting real games, which suite will you select?
>>Is it still LCT II?
>>
>>I wonder why WAC suite is still discussed here. It's too easy, when most
>>programs score 299/300 with 1 min level. Or may be 297/298 is they have null
>>move problems. But in any case You don't get any info by running WAC...
>>
>>Jouni
>
>
>You just run it for 5 seconds rather than 60 seconds.  Then you get a _lot_
>of information from it.

Find average time to solution which is held.  Then you extract gobs of
information from it.

Some programs just quit as soon as they find a solution, but this is a big
mistake.  Sometimes, they will change their mind and pick something else.  Once
in a while that something else even turns out to be a better solution.  At any
rate, the only time your program should stop analyzing is if it is a checkmate
and all previous plys have been exhausted.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.