Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Consensual positional problem set.

Author: Don Dailey

Date: 16:02:53 12/13/97

Go up one level in this thread


>I had a very similar idea a few months ago. As a result I have a
>positional test of 24 problems, all from great grandmaster games and all
>commented by grandmasters. I discarded positions with solutions not
>found by any programs. The main difference with your proposal is that
>instead of 30 minutes I used only 5, more or less the average amount of
>time in games played at 40:2.
>
>The test has been posted on CCR under the name "CCR Test", with results
>on a P200MMX/64. Below I post the global results of some programs and
>the test set. Please tell me what you think of it.
>
>Rebel 8/9          17
>Hiarcs 6           16
>Mchess 6           16
>Rebel 6            16
>Mchess 7           15
>Fritz 5            13
>Genius 5           12
>Shredder 1         11
>Fritz 4            10
>CM5K               10
>

Thanks for the feedback,  I'll try the test on Cilkchess.

I am hoping to build a pretty large set, hopefully at least
100 positions but I don't know how it will work out.  With your
permission I may append your set to the 1000
positions I start with, presumably most of them will survive
the "consent"  test and be in the final set.

I chose 30 minutes (which of course is subject to change) to
allow the set to grow a little with time.  I'm hoping that a
year or two down the road, it will still take modern programs
a few minutes to solve the harder problem.

As far as scoring is concerned, I would like time to solution
to be part of the scoring.  We can build a formula that makes
sense with regard to what is known about speed vs rating improvement
in chess programs.   It does make scoring a little more
complicated but should be more precise.  I'll try to keep it
as simple as possible.  Of course I'm still listening for ideas
from people out there.

It looks like the basic idea was originally your idea.  There seems
to be almost no difference in the two, except your positions were
hand picked first.  Anyway, the basic concept may be pretty sound.

-- Don




This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.