Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: No offense, but I think it invalidates the results.

Author: Albert Silver

Date: 18:23:42 01/18/06

Go up one level in this thread


On January 18, 2006 at 20:33:34, Graham Banks wrote:

>On January 18, 2006 at 20:02:28, Albert Silver wrote:
>
>>On January 18, 2006 at 19:18:42, robert flesher wrote:
>>
>>>Thank-you for the observation, however, unless its a book loss which it is not I
>>>think it is fair game. Although I understand that perhaps this can stastically
>>>alter the final results, maybe not. I guess book learning would fix this issue,
>>>it does give me some thinking to do, cheers.
>>
>>With all due respect, I think it simply invalidates the results. 1 game in 6 had
>>the exact same opening? How can one possibly compare the strength of the engines
>>in such a case?
>>
>>                                        Albert
>
>
>
>Hi Albert,
>
>I don't think you'll find that Robert is the only person who tests like this and
>he certainly won't be alone in thinking that it's fine, especially if learning
>is activated.
>Because I test with learning off and use generic books, I don't allow any
>duplicate opening lines, that is the position at which the engines leave the
>book.
>There are those who criticise this also.
>To each his own, but as long as testing conditions and preferences are made
>clear, members can make up their own minds about the usefulness or validity of
>any testing.
>
>Regards, Graham.


Indeed, and I made up mine and posted it. 31 times the same disastrously scored
opening? 13 for another? The same color in all occasions, and this is to go on
and on, and prove what? That if one repeats the same losing line that one
will... lose? Why not just have it play 200 straight times that same opening
with the same color and report the results? However, as you say, one can do as
one wishes. The problem is that if the intention is to make comparisons on a
program's ability, then you have failed, unless you mean only their competence
in that position.

                                     Albert



This page took 0.01 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.