Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: What is a good test suit to run for programs ....

Author: Robert Hyatt

Date: 12:01:53 10/05/00

Go up one level in this thread


On October 04, 2000 at 18:48:07, Joshua Lee wrote:

>That are too weak to register a LCTII or BS score?


Test suites are good for reasons most don't think about:

if you have results for version X, and version X+1 does worse, you
probably broke something.

If version X+1 does better, you probably improved something.

Comparing two different programs via test suite results doesn't say
much for either one.

Predicting ratings from test suite results is silly and unworkable.




This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.