Author: Albert Silver
Date: 13:27:20 06/07/01
Go up one level in this thread
On June 07, 2001 at 13:14:32, Robert Hyatt wrote:
>On June 07, 2001 at 12:33:44, Bruce Moreland wrote:
>
>>On June 07, 2001 at 10:52:33, Robert Hyatt wrote:
>>
>>>On June 07, 2001 at 06:41:44, Gian-Carlo Pascutto wrote:
>>>
>>>>On June 07, 2001 at 05:52:51, Jouni Uski wrote:
>>>>
>>>>>Yes I know all test suites are almost useless to finds the best playing chess
>>>>>software. But still, which suite is the less bad in your opinion? If You can
>>>>>only use one test suite before starting real games, which suite will you select?
>>>>>Is it still LCT II?
>>>>
>>>>Following Bruce Moreland's recommendations, I'd have to name ECM.
>>>>
>>>>--
>>>>GCP
>>>
>>>
>>>I don't like ECM as it has _way_ too many errors. The "modified" version
>>>might be reasonable.
>>
>>I don't see why the errors matter. So I fail on those, big deal. If I run WAC,
>>I get the same number every time. If I run ECM with more time, I'll find more
>>solutions. To me this means that if I make the program better, I'll find more
>>of them, which is what the suite is supposed to show. The suite has 879
>>positions. I think that well over 700 of them can be found, although I don't
>>have an exact number.
>>
>>bruce
>
>
>I don't like getting "better" and then getting more wrong answers. Or getting
>worse and getting more "right" answers. The ones that are wrong are really
>wrong. And it is certainly possible to make your program stronger and suddenly
>start getting the wrong answers rather than the right ones.
>
>IE it is like grading a test with a key that randomly gets changed without
>your knowing...
>
>I thought that was the reason we spent so much time going over the thing and
>excluding obviously bad positions?
Just out of curiousity, how long do the longest (and correct) solutions take?
Albert
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.