Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Rybka 32-bit is number one in CEGT rating list

Author: James T. Walker

Date: 17:29:06 12/07/05

Go up one level in this thread


On December 07, 2005 at 19:09:43, Uri Blass wrote:

>On December 07, 2005 at 18:51:01, James T. Walker wrote:
>
>>This information only makes me suspicious of CEGT testing.  I'm only running
>>blitz test but this engine is truely strange.  Against Shredder 9UCI it scored
>>about 145 Elo higher.  Against Fritz 8 it scored 50 Elo lower.  I only have 266
>>games so far but Rybka's rating now is about 33 Elo below Fruit 2.2.1 and about
>>3 Elo below Toga II 1.0.  I'm playing Rybka without an opening book since it
>>comes without one.  I don't know which book/books are being used by different
>>testers here but it does seem to indicate that almost any book is better than
>>nothing.
>>Jim
>I am not surprised that you get different results when you test different
>things.
>
>differences:
>
>1)CEGT do not test with original opening book
>2)CEGT test with ponder off and you test with ponder on
>3)CEGT test x minutes/40 moves when you test blitz games
>
>Uri

Hello Uri,
You are right of course.  The above are the reasons I don't like CEGT ratings.
At the same time I don't like testing Rybka without an opening book.  When I get
results like +145 Elo over Shredder UCI and - 50 Elo under Fritz 8 I know
something is not right.  Maybe Rybka was "tuned" against Shredder 9 UCI?  I'm
still running games without a book untill one becomes available though it seems
like a big disadvantage for Rybka.
Jim



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.