Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Duplicates test...

Author: Peter Berger

Date: 14:40:48 03/08/04

Go up one level in this thread


On March 08, 2004 at 14:31:02, Andrew Williams wrote:

>On March 08, 2004 at 04:32:22, Andrew Williams wrote:
>
>>On March 08, 2004 at 02:50:56, Peter Berger wrote:
>>
>>>On March 07, 2004 at 16:46:28, Andrew Williams wrote:
>>>
>>>>improvedpreferred 108.5 - 61.5 standardpreferred
>>>>
>>>>The previous match score was 158 - 119 standardpreferred before I stopped it.
>>>>
>>>>I would NEVER have imagined a result like it, and it has been VERY easy to do
>>>>this.
>>>
>>>
>>>Doesn't this sound a little too good to be true actually ?
>>>
>>>It might be worth to have a closer look at the game statistics. I fear there
>>>might be just one or two lines were the new preferred book outperforms the old
>>>one badly, and they get repeated often in selfplay as you have no learner.
>>>
>>
>>I checked the first match for duplicates and there were none. I'll have to test
>>the second one when I get back. Remember, I have the huge book to fall back
>>upon. I also have some time randomization just after the end of the book.
>>
>
>I ended the match when I got back from work this evening. There were a total of
>607 games and the final score was:
>
>newpreferred +341 -134 =232

Do you think this can be real? Just think of the rating difference this would
translate to . PM should be ready to face Shredder the day after tomorrow the
latest if this trend continues ;).

>
>I tested for duplicates and found none.

I worded this badly. I was thinking about some general line not duplicates that
might influence results heavily. I don't use SCID, but I know it can do
statistics on ECO codes as Dieter posted some in the past. Sample idea: PM used
to play E99 regularly with black, with white nearly always winning in selfplay
and gave up on this line with black after you changed the preferred book.

With such an effect taking place even the huge amount of games might not be a
sign of a real improvement at all.

Of course I hope we'll get the 100+ points improved PM instead, simply with some
general opening lines changed. Some of PM's opponents probably start to shiver a
little anyway ..

Cheers,
Peter

>
>Over the next few days, I'll be running some tests vs engines which are similar
>in strength to PM to see what happens!
>
>Andrew



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.