Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: why test suites are weak

Author: Johanes Suhardjo

Date: 11:31:36 03/13/00

Go up one level in this thread


On March 06, 2000 at 11:46:38, Jay Scott wrote:
>But even if you corrected that, there's still the problem that the
>suite won't be matched to each different program's style of play. In a real
>game a program can try to reach positions that it knows how to play well,
>but in a suite it has to take what comes. If a program plays to its own
>strengths it may play better than its test results say, and if it doesn't
>then it may play worse.
>
>To get a relevant test suite, test each program on positions that occur
>in its own games. This is easily done by having it play games. :-)

Very well put!
                         Johanes Suhardjo (johanes@nd.edu)
--
Shaw's Principle:
        Build a system that even a fool can use, and only a fool will
want to use it.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.