Computer Chess Club Archives


Search

Terms

Messages

Subject: Need for Improvement in the Set of Nunn Test Positions?

Author: Robert Henry Durrett

Date: 08:46:12 08/29/98

Go up one level in this thread


On August 29, 1998 at 07:32:47, Moritz Berger wrote:

<snip>

>Playing games from a set of opening positions (without book) is useful as it
>gives you an essentially non-quantitative means of comparing engine performance
>in well defined thematical testbeds. I.e. if I want to find out if and how you
>improved Rebel 10 beyond Rebel 9, I will have them play a number of opponents on
>the Nunn positions and (this is important!) not just add up results (this would
>be utterly wrong in my opinion since the initial set of positions might be
>biased in some ways) but take a closer look at deviations and understanding of
>different types of games (although the Nunn tests usually requires that the
>winner takes the initiative and therefore might favour some programs above
>others, e.g. Rebel 10 above Rebel 9 ;-)).

<snip>

QUESTION:  How good is the currently available set of Nunn positions?  Does the
above concern that "the Nunn tests usually requires that the winner takes the
initiative and therefore might favour some programs above others"  represent a
significant problem, or is this relatively unimportant?  Is there any ongoing
activity somewhere to continuously improve the set of Nunn positions?



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.