Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Ruffian Leiden vs. Shredder 8 (after 8 games)

Author: Christian Koch

Date: 04:23:54 01/18/04

Go up one level in this thread


Hi,

perhaps I will test Shredder 8 vs. Ruffian Leiden with their own books next
week.

On January 18, 2004 at 06:27:12, Sandro Necchi wrote:

>On January 18, 2004 at 06:20:27, Christian Koch wrote:
>
>>Hi,
>>
>>I want to test the chess engines, not the books. Did you have a look at the
>>games?
>
>OK, but supposed you get with your tests that program A is stronger than program
>B by 50 points, testing them without books.
>
>Now if you test them with their books and you get that program B is stronger
>than program A by 50 points, would you think that the book of program B gives
>100 points more than the book of program A?
>
>I do not think this would be the case, so I think these testings can only mean
>that in these specific positions program A play stronger than program B.
>
>I know a few games do not mean much, but I made similar tests many years ago and
>stop making them because I thought I could only get specific data and not
>general data.
>
>This is why I am telling you.
>
>Sandro
>>
>>
>>>Hi,
>>>
>>>this is interesting, but testing one program against another one giving selected
>>>positions does not give a true figure of the programs strenght, in my opinion.
>>>
>>>The reason why I have been working so long, and still am, on the books is that
>>>some programs like some positions and do not like others. This is why even the
>>>best program cannot play best in all positions and one needs to have at least
>>>the best 4 (in my opinion) if using them to test/check positions to get the most
>>>from chess programs.
>>>
>>>If the selected positions are more suiting the style of one program than the
>>>other chess program than the first one may win, but the real test (to me) is to
>>>test them with their own books as the opening book is part of the program;  a
>>>very important part. To test with a different book and/or with a book we should
>>>not use the same name as well as it would be like test the Ferrari with the
>>>engine made for another car or a different shape...it is not the Ferrari
>>>anymore...
>>>
>>>This is my opionion based on my experience.
>>>
>>>Sandro



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.