Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: What's really odd is...

Author: enrico carrisco

Date: 17:27:53 12/15/05

Go up one level in this thread


On December 15, 2005 at 04:20:17, Vasik Rajlich wrote:

>On December 14, 2005 at 19:20:46, enrico carrisco wrote:
>
>>On December 14, 2005 at 14:32:59, Vasik Rajlich wrote:
>>
>>>On December 14, 2005 at 14:14:36, enrico carrisco wrote:
>>>
>>>>On December 14, 2005 at 05:30:59, Vincent Lejeune wrote:
>>>>
>>>>>On December 14, 2005 at 05:22:16, Gian-Carlo Pascutto wrote:
>>>>>
>>>>>>On December 14, 2005 at 05:13:48, Joachim Rang wrote:
>>>>>>
>>>>>>>On December 14, 2005 at 05:06:41, Mimic wrote:
>>>>>>>
>>>>>>>>==============================================================
>>>>>>>>Rybka 1.0 Beta 32-bit  +282-130=388  59.50%  476.0/800   +66
>>>>>>>>--------------------------------------------------------------
>>>>>>>>Fruit 2.2.1            +130-282=388  40.50%  324.0/800   -66
>>>>>>>>==============================================================
>>>>>>>>
>>>>>>>>  Games       Rybka
>>>>>>>>========================
>>>>>>>>  100          +31
>>>>>>>>  200  -----   +33
>>>>>>>>  300          +50
>>>>>>>>  400  -----   +50
>>>>>>>>  500          +53
>>>>>>>>  600  -----   +60
>>>>>>>>  700          +63
>>>>>>>>  800  -----   +66
>>>>>>>>========================
>>>>>>>>
>>>>>>>>Pentium M Dothan 2.52Ghz
>>>>>>>>32MB Hash
>>>>>>>>No EGTB
>>>>>>>>
>>>>>>>>Mimic
>>>>>>>
>>>>>>>has Rybka some hidden learning? The steady increase of the rating difference is
>>>>>>>surprising.
>>>>>>
>>>>>>The rating difference didn't increase, just the plus score. (And it wasn't
>>>>>>steady, either)
>>>>>>
>>>>>>--
>>>>>>GCP
>>>>>
>>>>>
>>>>>No, +66 is the rating difference, not the score difference.
>>>>>
>>>>>Surprisingly it doubled between 200 and 800 games...
>>>>>Who know it will be after 1200 games ...
>>>>
>>>>Rybka scores SIGNIFICANTLY better (15-20%+) vs. a given opponent (Fruit 2.2.1 in
>>>>this case) in an engine-engine match than it will in a tournament style match
>>>>with MORE than two engines (i.e. engines being routinely loaded and unloaded.)
>>>>
>>>>Try it yourself.
>>>>
>>>>Regards,
>>>>
>>>>-elc.
>>>
>>>There is no learning or opponent recognition in Rybka, so this observation is
>>>likely an anomaly.
>>>
>>>The only other explanation is that the opponents are "learning" :)
>>>
>>>Vas
>>
>>Hello Vasik.
>>
>>That's very interesting then...  I will do some more tests and see if this
>>continues (as well as check the results of others that test but do not post
>>here.)
>>
>>So far I have 4 tournaments (at least 3 engines inlcuding Rybka) with 126 games
>>each tournament and 5 engine vs. engine matches (also 126 games each) and
>>Rybka's percentage against the same opponents in the tournament are better (by
>>at least 15%) when it is engine vs. engine only.
>>
>>Hopefully continuing the matches will break the anomaly.  :)
>>
>>Regards,
>>
>>-elc.
>
>That would be quite an anomaly.
>
>Can you also check to make sure that there isn't some sort of weird load-time
>problem?
>
>Thanks,
>Vas

Hello Vasik.

Can you be more specific?  I first saw this message late last night and decided
I'd wait until the next day since I was miserably tired and didn't exactly
understand your question.  I have no excuse of being tired now and I am still
sitting with the "lights out."  :)

In the Chessbase GUI during a tournament, engines load at the beginning of the
match (before it starts) and unload at the end of the match.  I don't think
there is any way a "time to load" could affect the game and I do not notice
Rybka taking an excessive time to load compared to the other engines (and UCI
engines) in the tournament.

Let me know more specifically what you'd like me to check and if necessary, my
email is listed correctly here under my name.

Saluti,

-elc.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.