Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Ultimate Use of Suites of Test Positions???

Author: Robin Smith

Date: 11:32:53 12/07/02

Go up one level in this thread


On December 06, 2002 at 20:11:31, Bob Durrett wrote:

>In other words, I propose a comprehensive test which has, itself, been tested
>and verified against the SSDF [and similar] test data.

It is trivial to desing a test that makes Fritz look smarter than all other
programs.  Or a different test that makes Shredder look the smartest.  Or
another that makes Tiger look smartest, etc.  Your idea of making test results
correlate with SSDF results gets around this, but then what purpose does the
test serve?

The SSDF already is a test.  No set of test positions will be able to predict
SSDF results more acurately than the SSDF results themselves.  So what purpose
is served by a set of test positions?  The only advantage I can see for such a
test is to get quicker results for programs not tested yet by SSDF.  But the
results will also always be highly suspect.

Robin

P.S.  Like you, I am also an electrical engineer, and I don't believe your
earlier statement that "Engineers are NOT adept at intellectual sparring!"  In
fact, while I have an MSEE degree, I also have a Philosophy degree (the ultimate
degree for those who like to engage in intellectual sparring).



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.