Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Ruffian Leiden vs. Shredder 8 (after 8 games)

Author: Sandro Necchi

Date: 03:27:12 01/18/04

Go up one level in this thread


On January 18, 2004 at 06:20:27, Christian Koch wrote:

>Hi,
>
>I want to test the chess engines, not the books. Did you have a look at the
>games?

OK, but supposed you get with your tests that program A is stronger than program
B by 50 points, testing them without books.

Now if you test them with their books and you get that program B is stronger
than program A by 50 points, would you think that the book of program B gives
100 points more than the book of program A?

I do not think this would be the case, so I think these testings can only mean
that in these specific positions program A play stronger than program B.

I know a few games do not mean much, but I made similar tests many years ago and
stop making them because I thought I could only get specific data and not
general data.

This is why I am telling you.

Sandro
>
>
>>Hi,
>>
>>this is interesting, but testing one program against another one giving selected
>>positions does not give a true figure of the programs strenght, in my opinion.
>>
>>The reason why I have been working so long, and still am, on the books is that
>>some programs like some positions and do not like others. This is why even the
>>best program cannot play best in all positions and one needs to have at least
>>the best 4 (in my opinion) if using them to test/check positions to get the most
>>from chess programs.
>>
>>If the selected positions are more suiting the style of one program than the
>>other chess program than the first one may win, but the real test (to me) is to
>>test them with their own books as the opening book is part of the program;  a
>>very important part. To test with a different book and/or with a book we should
>>not use the same name as well as it would be like test the Ferrari with the
>>engine made for another car or a different shape...it is not the Ferrari
>>anymore...
>>
>>This is my opionion based on my experience.
>>
>>Sandro



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.