Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: fritz 8(bilbao) v Chessmaster 10 K

Author: John Merlino

Date: 11:26:53 01/24/05

Go up one level in this thread


On January 24, 2005 at 12:33:24, adam wilks wrote:

>I tested Fritz 8 bilbao in Chessbase with King 3.33 in Chessmaster 10 K
>interface(using default settings) in  5 minute games. King 3.33 won 3, drew 2
>and lost 1. Does this reflect king 3.33 strength? If not what are the optimum
>settings to find its optimum strength(i e through  what opening books? should i
>use theor own or custom made books like AMD XP or 5moves ctg? Or should i run a
>tourney with both engines over the John Nunn test? as this last idea might have
>a better grasp of an engines strength? or should i not include an opening book
>and let the engines just play chess themselves?

All you can say with certainty is that CM won a 6-game match against Fritz at a
5-minute time control. You can CLAIM that, because of this result, CM is
stronger than Fritz, and you may be right. But the margin of error is so huge
that nobody will accept this statement.

Generally, around here we need at least 100 games in a very controlled setting
before we start to accept any statistical findings.

As for "optimum settings" for The King, this debate will rage on forever, since
there are, practically speaking, an infinite number of possible combinations of
settings (not to mention different opening books and time controls).

A great deal of testing has already been done over the years, and, of course, it
needs to be pretty much thrown away with each new version of the engine. All you
can really hope to achieve are finding "the best known settings under my test
conditions".

jm



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.