Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: CM 6000 engine personalities tests question

Author: Harald Faber

Date: 03:48:12 12/15/98

Go up one level in this thread


On December 15, 1998 at 06:19:06, Arda Renkver wrote:

>I have read many interesting postings in here about those tests you guys
>conducting. My question is that if you are just testing the engine strength for
>different settings shouldn't the opening books be turn off in any case.Otherwise
>you get no feeling as to how the "setting" is able to handle a position without
>finding itself in a comfortable situation in which it arrives by using opening
>theory from memory.In this case you only have match results without knowing
>whether or not the result due to opening advantage or disadvantage.Maybe playing
>with a set of predetermined openings with white and black would clear the cloud
>a bit.I believe Mr.Kaufman (IM) used to suggest that a long time ago in print.

You are right. :)
Although you can never be sure to have a better result because of the opening
book (if you kept the settings and only changed the book) or because it was kind
of chance unless you have played MANY games. And MANY is much more than 50.
For instance at the moment (this week it will end) I am playing MCP7-Nimzo98 and
will get 60 games. Within these 60 games you can pick out 10 in a row and can
get VERY different results with these 10 games comparing to another set of 10
games! So if you interpret them you can be VERY wrong.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.