Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Arasan games test suite - latest version

Author: Andrew Williams

Date: 05:31:12 07/02/99

Go up one level in this thread


On July 01, 1999 at 14:31:35, Jon Dart wrote:

>I have put together a test suite of positions from games Arasan
>has played, mostly on FICS or ICS. I posted an earlier version of
>this some time ago but since then I have removed some easy positions
>and ones without clear solutions, added some new positions, and
>tried to carefully verify solutions for the ones that are in the suite.
>The latest version is given below.
>
>I usually run this test at 60 seconds per move and Arasan is
>presently scoring about 56 out of 90 correct on a K6-2/400 using
>16MB hash.
>
>I would welcome feedback, especially if you think any of the
>solutions are incorrect (note: a few are quite difficult and will
>take most programs much longer than 60s to solve).
>
>The positions are also available on my website
>http://www.best.com/~jdart/arasan.htm (see the link near the end
>of the page).
>
>--Jon

[longish testsuite snipped]

Hi Jon,

I had a bash at your suite with PostModernist. It managed to get/avoid 53/90
on my K6-2 300 with 500K hash entries. I'll have to have a more detailed look,
of course, because I fear with the avoid move entries, it might have
avoided the bad move but found another equally poor one. What do you do
about this?

BTW My program no longer sees #89 (see "interesting position" post below).
The version that encountered it on ICC had a serious evaluation bug. Removing
the bug has cost me the ability to solve this position in under 60 seconds!


Andrew




This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.