Author: Dan Kiski
Date: 12:22:38 12/15/98
Go up one level in this thread
On December 15, 1998 at 13:39:58, Peter McKenzie wrote: >I do not regard using the Nunn positions as a good way to test a chess program, >but then it depends on what you are trying to test. > >When I test my chess program, I'm trying to find out how well it plays the game >of chess (!). The game of chess starts from the initial position, hence I do >most alot of my testing from there :) From what I read further down you do not, your testing begins once the program is out of book knowledge. Note that strength in playing the game of >chess is a different thing to strength in analysing a given set of positions: >the two are related but NOT the same. > >The fact that program A is better than program B at playing the Nunn positions >may or may not mean that program A is likely to win a match against program B >playing the game of chess (from the START position). I agree. >Perhaps you are interested in which program is better at analysing positions >selected at random from GM games in which case maybe the Nunn positions may be a >representative set. Personally, I'm not so interested in this. > >The book is an integral part of a chess program, the engine programmer makes >design decisions with the book in mind. Agreed it is, but it also don't measure engine strength. Playing test games without the book >and/or from the Nunn positions is like making 2 soccer teams play test games and >being forced to play in 4-4-2 formation, or like making NBA teams play test >games using a triangle offense. These teams may or may not have been >picked/designed to play that way - they may do better using their own formation >so its better just to let them play normally. I disagree, as newer programs come out with upgraded opening books, the advantage that the newer program has from the point it gets out of book can have already determined the outcome of the game regardless of engine strength. Example: Try playing Fritz 5 with Fritz 5 book v Fritz 5 with no book or with Fritz 4 book, I have and with book will win the majority of games, yet we have two identical engines, the reason opening book.
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.