Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Rybka 32-bit is number one in CEGT rating list

Author: Zappa

Date: 08:29:59 12/07/05

Go up one level in this thread


On December 07, 2005 at 08:10:37, Kirill Kryukov wrote:

>Hi all,
>
>I'm happy to announce the update of CEGT 40/40 lists and statistics. We have now
>more than 540 games of Rybka 1.0 Beta 32-bit, and also 104 games of 64-bit
>version. 32-bit Rybka is now prowdly leading our main rating list. Rating of
>32-bit version is not that incredible as it was expected, but still good enough
>to secure the 1-st place, for now. 64-bit version is probably stronger. We are
>continuing testing both versions, so there will be more certain answers soon.
>
>Toga II 1.1 rating now stabilized, after 1000 games. We can probably say now
>that it did not catch Fruit 2.2.1.
>
>Main rating list (best versions with 300 games):
>http://kd.lab.nig.ac.jp/chess/cegt/rating-table-shifted.shtml
>
>Rating list for all versions:
>http://kd.lab.nig.ac.jp/chess/cegt/rating-table-all-shifted-hidden.shtml
>
>CEGT 40/40 downloads and statistics:
>http://kd.lab.nig.ac.jp/chess/cegt/
>
>Previous version of the ratings and statistics, for reference:
>http://kd.lab.nig.ac.jp/chess/cegt.0/
>
>
>
>Some of my observations about Rybka:
>
>1. Rybka is not afraid of doubled pawns. Shredder loves making double pawns to
>the opponent, it is very happy to do this. Rybka does not worry to have double
>or triple pawns, and with incredible coordination of pieces those doubled pawns
>become a fortress.
>
>2. Rybka can organize a bishop and pawns into fortress. I've seen it already in
>several games for now - Rybka builds up a total fortress structure of pawns with
>bishop in the middle, somewhere near the center, paralizing the opponent pieces.
>This is sometimes funny to see. Shredder does not know what to do.
>
>3. Rybka hesistates to checkmate. It does not like to checkmate. When it has
>enough advantage to go for mate, it keeps doing other things! It eats up
>opponent's pawns, it promotes its own pawns, and finally checkmates when it has
>nothing more to do... This is real funny, I observed it a few times now too. In
>one game Rybka took 25 moves to checkmate a king with two pawns with two queens,
>it first picked those two pawns, then played with that king a little more and
>finally it got tired and checkmated.. Vas was right to be ashamed of Rybka's
>endgame, there are things to fix there still.
>
>Rybka's games are fun to see, because they are not just crazy calculation, but
>some understanding is involved too. It really feels more "human" than any other
>engine I've seen.
>
>Best,
>Kirill

Yes, this doesn't surprise me too much.  When there is a new entry, people that
get great results post immediately, and people that get bad results think they
did something wrong and redo their tests :)  The same thing happened with
Ruffian.  I also think that a big part of Rybka's strength is tactical, and
people posting blitz results will post earlier.  I remain very impressed with
it, but it does appear that its been overhyped a bit.  Of course, I'm OK with it
being overhyped if it increases interest in computer chess!

I am also curious which books you used for Shredder-Rybka and Fritz9-Rybka.

anthony

P.S.  I really like your statistics page!

Some things I'd like to see: in the Pairwise page, how this performed relative
to expectations.  Example: Engine X has rating 100 and Engine Y rating 150.
However, X scored 75% vs Y (+250 elo), so the value would then be +300 (X
performed 300 points better than expected vs Y).

Also, on the "eval differences" page the raw eval difference isn't very
interesting IMO.  For example, when Zappa is winning and Crafty is losing its
eval is usually +5 pawns higher or something.  What I think would be more
interesting would be to sort the eval differences and then take the values at
25%, 50%, and 75%.  So if the eval differences were 1 1 1 20 20 20 50 50 50 500
500 500 we would get (1, 20, 50) rather than the arithmetic average which is
probably 100+.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.