Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: RK 2003 [120'/60] Comparison old / new

Author: George Tsavdaris

Date: 15:02:09 07/18/03

Go up one level in this thread


On July 18, 2003 at 13:19:47, Kurt Utzinger wrote:

>English
>If we compare the following, nobody would believe that the same engines had
>played the same tournament with only a small difference: the books

Is this a coincidence because of the few games or indeed the books play such
a big part in the "strength"=performance of the engines? This is not only
minor changes but a big difference. Junior from last is first and TK 3.23
has 7 points less!
It's a very important question if the book is really a major factor for the
"strength" of the engines. And if in a given number of engines, there is
a book, that makes a specific engine A to play better against the others,
than using any other book. This must be true, but it is a question if "better"
is much better or slightly better. If it's much better, then the rating lists
of SSDF and the tournaments many others make don't really give the real
strength.
I will make a 1000 blitz 3min/game game, between Fritz and Ruffian with
Remis.ctg and Fritz8.ctg, where in 500 games Ruffian will have remis.ctg and
the other 500 Fritz8.ctg and see what happen, but i think i will not be
able to conclude anything.
As for the "small" difference you said about the books: The book is nothing
more than a statistical super knowledge of millions of games by human GM's
and IM's. So it's like having a searching algorythm based on statistics and
on human chess creativity, for the first 7-15 moves where no immediate threats
or (short-medium) tactics (especially on the first 4 moves) are exist. So the
opening book is an engine that plays the move according to statistics and thus
is very important in a chess game played by an engine. Because todays opening
books are created with similar databases the quality of the moves is the same
in all good commercial books. But the problem is that for a specific engine
the ending position of the book must be understood by this engine and fit
to it's playing style. Obviously Junior 8 "hate" remis.ctg and this mean that
some positions of it, are a mystery to Junior. That's why there must be
a book for every engine, that makes it to play with maximum stength. The
problem is finding this book for every engine.

>
>RK 2003 tournament 120'/60+60'/30+30'
>Results with draw book remis.ctg for all engines
>after 84 games [each engine 21 games]
>
>    Program                            Score     %    Av.Op.  Elo    +   -
>
>  1 TK 3.23 SKR                    :  15.5/ 21  73.8   2476   2656  129 141
>  2 Fritz 8                        :  11.5/ 21  54.8   2495   2528  158 118
>  3 Shredder 7.04                  :  11.0/ 21  52.4   2497   2513  162 109
>  4 Hiarcs 8                       :  11.0/ 21  52.4   2497   2513  162  96
>  5 Chess Tiger 15                 :  10.5/ 21  50.0   2499   2499  122 122
>  6 Ruffian 1.0.5                  :   9.0/ 21  42.9   2505   2455   97 153
>  7 Deep Sjeng 1.5                 :   8.0/ 21  38.1   2509   2425  100 145
>  8 Junior 8                       :   7.5/ 21  35.7   2512   2410  148 142
>
>
>RK 2003 tournament 120'/60+60'/30+30'
>Results with own books for all engines
>after 84 games [each engine 21 games]
>
>
>    Program                            Score     %    Av.Op.  Elo    +   -
>Draws
>
>  1 Shredder 7.04                  :  13.0/ 21  61.9   2490   2574  145 100
>  2 Junior 8                       :  13.0/ 21  61.9   2490   2574  145 117
>  3 Fritz 8                        :  11.0/ 21  52.4   2498   2515  162 109
>  4 Ruffian 1.0.5                  :  11.0/ 21  52.4   2498   2515  162  96
>  5 Deep Sjeng 1.5                 :  10.5/ 21  50.0   2500   2500  133 133
>  6 Hiarcs 8                       :   9.5/ 21  45.2   2504   2471   89 158
>  7 The King 3.23 skr              :   8.5/ 21  40.5   2508   2441  107 149
>  8 Chess Tiger 15.0               :   7.5/ 21  35.7   2513   2411   91 142
>
>http://www.utzingerkurt.com (section RK 2003)



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.