Computer Chess Club Archives


Search

Terms

Messages

Subject: CCC test suite

Author: Don Dailey

Date: 12:19:08 01/18/98


Bob, Amir, others,

I ran the full suite to approx 30 seconds.  I assume Amir is
planning on running the set too to give us 3 programs.  Is that
correct?   We don't want too many running because we may end
up with too many easy problems since we want everyone to agree
on the easy ones.

But we want everyone to find cooks, multiple solutions and
other difficulties that will allow us to throw out bad problems.
Bob Hyatt will be the final judge!  Post your positions and
why you think it's bad so Bob can rule on it and we can all
see.

I also recommend we partition the set so that we have a hard
group. ( ccc-hard.epd )  This could be any problems where
none of the programs solve in the 10 second period.

When I ran the set I identified 3 flaky positions.  I define
"flaky" as any position that is "solved" and unsolved once or
more (whether it's solved again or not.)  I do not count
solutions on the 1st iteration because it is normal to see
bad moves before finding good ones.

I haven't checked them out yet so maybe my program has a bug
or something but here they are for everyones inspection:

3rr1k1/1p1qb2p/pP4p1/2p2p2/4RQ2/3P4/1PPB2PP/4R1K1 w - - bm Bc3; id
"ECM.420";
6k1/rnqb3p/5ppQ/2pPp3/p1N1P3/2PB3P/5PP1/1R4K1 w - - bm f4; id "ECM.422";
1q4k1/p3rppp/3b1n2/8/5P2/4P3/PP1B3P/RNQ3K1 b - - bm Bxf4; id "ECM.505";

Chances are if I ran deeper I would find more.  Other programs
should check for this too, I'll bet each program finds different
ones.

- Don








This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.