Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: The Rybka Flamewar & question for Vasik

Author: Uri Blass

Date: 21:03:43 02/16/06

Go up one level in this thread


On February 16, 2006 at 19:24:41, Rolf Tueschen wrote:

>On February 16, 2006 at 18:37:18, Uri Blass wrote:
>
>>On February 16, 2006 at 18:28:31, Rolf Tueschen wrote:
>>
>>>On February 16, 2006 at 17:58:27, Chessfun wrote:
>>>
>>>>As this table shows other engines like Spike 1.0 and SmarThink are far closer to
>>>>Fruit than Rybka. As for Toga the numbers speak for themselves.
>>>>
>>>>http://kd.lab.nig.ac.jp/chess/CCRL-4040/engine-distance-table-all.shtml
>>>>
>>>>Sarah.
>>>
>>>
>>>I doubt that these results have a bigger meaning but just an impression: it
>>>looks as if Hiarcs has bought something from Chess Tiger.
>>
>>I think that simply not enough moves were played.
>>
>>98 moves are not enough.
>>
>>Uri
>
>I saw it here
>
>http://kd.lab.nig.ac.jp/chess/CCRL-4040/eval-difference-table-best-limited.shtml
>
>but you are right, this is strange. Allegedly it is 150 games but only 98 moves
>counted... So therefore all in all I concluded that the tables have no value.

The main question is what is the number of games between the 2 engines.

In the relevant case the 98 moves are result of exactly 3 games between tiger
and hiarcs.

I found it in
http://kd.lab.nig.ac.jp/chess/CCRL-4040/details.shtml#Chess_Tiger_15

Tiger15–   Hiarcs 10 (2837) (2836) +1−0=2 66.7% +152 +139






This is not correct that the tables have no value.
They could be explained better but they give information that have value.

small value indicate big similiarity if the number of moves is big enough.

values above 1000 for the number of moves are big enough.
values above 300 for the number of moves are also probably big enough.
values under 100 for the number of moves are certainly not big enough.

I think that it may be good to have a similiar table that include only pair of
programs with at least 300 moves(for the same reason that you have rating list
of programs that only have at least 300 games).

Note that the fact that all programs have at least 150 games is unimportant for
the table of difference between engines and it is possible to have a table for
all programs when you include only pair of engines with at least x moves for x
that you choose.



>Also the background of the tables isnt discussed at all. Why this and what
>exactly... That isnt sound. I see we two are agreeing here, Uri.

Not exactly.

I agree that there is a room for improvement in the tables.
I do not agree that the tables have no value.

Uri



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.