Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Rybka 1.01 Beta 13 b First impressions

Author: Vasik Rajlich

Date: 16:33:23 01/29/06

Go up one level in this thread


On January 29, 2006 at 13:23:57, Albert Silver wrote:

>On January 29, 2006 at 12:52:24, M Hurd wrote:
>
>>On January 29, 2006 at 09:30:45, Albert Silver wrote:
>>
>>>On January 29, 2006 at 08:32:13, Vasik Rajlich wrote:
>>>
>>>>On January 28, 2006 at 16:50:28, Albert Silver wrote:
>>>>
>>>>>On January 28, 2006 at 14:06:00, M Hurd wrote:
>>>>>
>>>>>>It seems that 13 b's search has been speeded up. On some test positions it seems
>>>>>>to get through the plys slightly quicker than previous versions and will
>>>>>>sometimes find the solution 1 ply earlier. For the testing of positions with
>>>>>>previous versions of Rybka the search soundness setting Ultrasolid appeared from
>>>>>>limited testing to be better than solid, however with 13b solid seems better,
>>>>>>what do others here think ? Whether this is true with games only time will tell.
>>>>>>
>>>>
>>>>I am 99.9% sure that ultrasolid is either better than solid in all of the Betas,
>>>>or worse than solid in all of the Betas.
>>>
>>>Perhaps a 4th opponent is necessary. In my testing, UltraSolid scores a bit
>>>better with Fritz 9, about the same against Hiarcs 10, and worse against Fruit
>>>2.2. Worse enough that it kills whatever it gains from Fritz 9 and then some, so
>>>that after the 150 games of the 3 matches it actually does a fraction worse.
>>>This has happened twice though. Maybe I'll try one of its most difficult
>>>opponents in my previous testing: Gambit Fruit 4bx, and see what happens.
>>>

This is tricky. I would be surprised (but not shocked) if such an effect
existed.

However, the thing to keep in mind is that by looking for such patterns, you
effectively "dilute" your data.

If you play enough games, and entertain enough hypotheses, then some of them
will be true by accident.

Of course, once you identify a particularly promising hypothesis, you can test
it further and get an honest result.

Anyway, it's late so I probably am not making much sense :)

Vas

>>>
>>>>
>>Ok I'll do the same. I here what vasik says and he is the author. I bet you can
>>sense a but coming on, have a look at this:
>>
>>http://www.talkchess.com/forums/1/message.html?481879
>>
>>That was Beta12 now lets look at Beta13b.
>
>I'll be testing with Beta 13 and not 13b though. The reason is that I already
>have the results of the default settings of Beta 12/13, as well as others. There
>is no reason to presume that the parameter will work better with the hash change
>he made compared to others. Otherwise I'd have to re-run the defaults settings
>of 13b as well.
>
>                                         Albert



This page took 0.01 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.