Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Both engines used their own book

Author: Uri Blass

Date: 00:20:55 11/27/04

Go up one level in this thread


On November 27, 2004 at 00:06:43, Peter Darin wrote:

>ya but do u think u can get fair result by using Slowchess Book which is not
>that good. Instead using differant book might help give u the correct picture of
>Engine's Strength.
>
>Regards
>
>Peter

You can get totally fair result.
books is part of the package that you test.

I also think that books are overestimated and the proof is
List that comes with no book

Tests when List used the nunn positions(no book for both sides) showed the
following results:

http://www.husvankempen.de/nunn/ratingnunn0309.txt

1 Shredder 8                     : 2836   18  26   840    69.5 %   2693   24.9 %
  3 Pro Deo 1.0 09/01              : 2823   27  47   340    75.5 %   2626   24.7
%
  4 Fritz 8                        : 2809   19  24   840    65.9 %   2694   25.4
%
  5 Hiarcs 9                       : 2784   19  22   840    62.5 %   2696   27.9
%
  6 Chess Tiger 15.0               : 2783   20  21   840    62.3 %   2696   30.2
%
  7 CM9 Gladiator                  : 2778   20  21   840    61.6 %   2696   29.6
%
  8 Junior 8                       : 2773   20  22   840    60.9 %   2696   24.6
%
  9 Ruffian 2.1.0                  : 2759   21  20   840    58.9 %   2697   29.0
%
 10 Ruffian 1.0.5                  : 2754   19  24   762    66.0 %   2639   29.9
%
 11 List 512                       : 2733   15  15  1520    58.2 %   2676   31.1
%
 12 Gandalf 5.1                    : 2705   24  19   840    50.8 %   2699   24.0
%
 13 Deep Sjeng 1.6                 : 2698   23  18   880    50.8 %   2693   28.0
%
 14 Ktulu 5.1                      : 2696   23  17   880    50.5 %   2693   32.0
%
 15 Aristarch 4.50                 : 2692   18  25   882    67.1 %   2568   24.0
%



List is only 41 elo better than aristarch.

If books are important you can expect List with no book to perform clearly worse
than Aristarch but it turns out that list is 73 elo better than Aristarch and
279 elo better than Ktulu5.1 when list does not use book and aristarch and ktulu
use books:

see http://freehosting.hostrave.com/p/iggor/nil/NIL7_rat.txt

I know that a lot of varaibles are different(not same time control not same
opponents but it still seems that if there is no problem of losing the same
opening again and again books are not very important).

Uri



This page took 0.01 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.