Computer Chess Club Archives


Search

Terms

Messages

Subject: Elo performances of Rybka settings in my testing

Author: Albert Silver

Date: 14:55:43 12/24/05

Go up one level in this thread


On December 24, 2005 at 16:43:16, Nolan Denson wrote:

>Maybe it has something to do with what version you are using.  I using the 64
>Bit version while playing on PlayChess.  I tried the others but, for me ST
>played much much better.

How many games and what were the test conditions? I tested the VP, SP, and ST
under identical conditions over 160 games for each. Meaning the same 4
opponents, using the Nunn2 set. The final results were:

Rybka 1.0 "very positional" (default)

vs. Deep Fritz 8            24 - 16
vs. Chess Tiger 15        30.5 - 9.5
vs. Fruit 2.2             25.5 - 14.5
vs. Gambit Fruit 4bx      25.5 - 14.5


Rybka 1.0 "slightly positional"

vs. Deep Fritz 8          30.5 - 9.5
vs. Chess Tiger 15          29 - 11
vs. Fruit 2.2               27 - 13
vs. Gambit Fruit 4bx      21.5 - 18.5


Rybka 1.0 "slightly tactical"

vs. Deep Fritz 8          24.5 - 15.5
vs. Chess Tiger 15        27.5 - 12.5
vs. Fruit 2.2               23 - 17
vs. Gambit Fruit 4bx        24 - 16


Athlon64 Sempron 3400+
Hash: 256 Mb each; ponder off
Time Control: 10 mins + 2 secs
Nunn2 Openings Set

In order to give a rough idea, I gave the opponents ratings as follows in order
to see a comparative Elo performance of the Rybka settings:

Fruit 2.2:         2830
Gambit Fruit 4bx:  2800
Deep Fritz 8:      2780
Chess Tiger 15:    2730

This would yield the following performances for the Rybka settings over 160
games each:

Rybka "VP" -  2913.25
Rybka "SP" -  2915.75
Rybka "ST" -  2878.5

So while the difference between VP and SP is up in the air in this short amount,
ST is clearly lagging.

                                        Albert



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.