Author: Amir Ban
Date: 15:04:29 01/19/98
Go up one level in this thread
On January 19, 1998 at 13:30:39, Robert Hyatt wrote: >On January 19, 1998 at 03:39:23, Don Dailey wrote: > > >the only thing I want to see is a suite where each position has a clear >solution, whether it be hard or easy, but where the solution move is not >something that might show up "just because". IE the solution should be >a tactical solution that requires a move that wouldn't normally be >played, >so we can compare apples to apples. The position Bruce mentioned from >the >BK test is but one example. Many people have, over the years, reported >WAC results where they simply found the best move positionally without >having any idea that it ends up winning material or mating. I'd like to >see our suite produce unambiguous results... > > >I'd like to suggest the following way to get this started: > >lets take the first 100 positions to begin with. If we all agree that >10 seconds is too easy, that's fine by me. If we'd rather look at them >more carefully and eliminate the 3-4 ply solutions instead, it doesn't >matter. But first, let's eliminate the easy ones. After we agree on >those, then lets eliminate the ambiguous ones, or the ones with too many >solutions, or the ones that we can't confirm that the solution is really >best, etc... > >I will tally the results. I'd like to see Bruce do the same. Then we >can compare notes to be sure neither missed a comment by someone. When >we >reduce the first 100 to N, then we move to the next 100. 100 seems >managable, >without producing huge posts. I don't object to your plan, but I have a slightly different target in mind. I see more advantages than drawbacks in having a large suite. What I don't want is to count one less when I should be counting one more because the solution is not correct or there are others. I don't mind the "flakes", and I think the "easy" ones have a place because this means the suite has sensitivity to running at very short times. By all means go ahead with your plans, but my first priority is to get the bugs out of the suite. Amir
This page took 0.01 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.