Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: The ecm test suite (bruce, bob?)

Author: Robert Hyatt

Date: 18:26:24 08/15/01

Go up one level in this thread


On August 15, 2001 at 06:52:18, Peter Kappler wrote:

>On August 15, 2001 at 05:03:20, Peter Fendrich wrote:
>
>>Has anyone tried to clean up the ecm test suite?
>>//Peter
>
>
>There was a big effort here (or was it rgcc?) a few years ago.  I don't know if
>anybody went through the effort of verifying all the fixes and publishing a
>"clean" version.  I remember that many of the fixes/alternatives were very deep
>variations and took a lot of CPU time to verify.
>
>Bruce Moreland has mentioned that he likes ECM -- he might have been part of
>this effort.  Probably Bob was in on the action, too.  I can't recall the other
>participants.
>
>It would be neat to try cleaning it up again.  Machines are much faster now.  :)
>
>-Peter


Several of us worked on this. Bruce.  Myself.  Amir.  I don't recall the others.

The problem I have with the suite as distributed is that there are many bugs in
it.  Bugs that make right answers look wrong and wrong answers look right.  This
latter problem can make a better result look worse, which makes interpretation
quite difficult.

I'm certainly willing to go at it again.  Although if we are going to do this,
I would suggest we take it 50 or 100 positions at a time, and run them and then
cull the bad ones.  If we end up with 500 good ones, we would still have a good
test.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.