Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Different test suite method?

Author: Anthony Cozzie

Date: 13:49:38 06/15/04

Go up one level in this thread


On June 15, 2004 at 15:33:41, David Dahlem wrote:

>One of the problems with the current method of testing engines with test suites
>(e.g. WM-Test) is the problem of proving that the proposed solution move is
>actually the best move, especially with positions of a positional nature.
>Perhaps a new method would avoid this problem, namely a suite of mate positions,
>with known, more easily proven solutions? Time to solution could be the criteria
>by which engines are evaluated.
>
>Just an idea. Any thoughts? Would this work?
>
>Regards
>Dave

All the people here with strong engines (Bob, Vincent, GCP, me) are all saying:
test suites don't cut it.

However, it would be an interesting experiment to make a test suite with 1/2
tactical moves that win and 1/2 tactical moves that lose, e.g. a promising sac
that needs to be avoided.

anthony



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.