Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: What is Wrong with Shredder 7.0.4's Position Evaluations?

Author: Bob Durrett

Date: 09:36:08 09/12/03

Go up one level in this thread


On September 12, 2003 at 09:46:24, Gian-Carlo Pascutto wrote:

>On September 12, 2003 at 09:03:47, Bob Durrett wrote:
>
>>There is a computer programming issue here, too.  Are the position evaluation
>>scores displayed on the monitor actually used by the engine during the >searches?
>
>They are vital and used everywhere.
>
>>Maybe Shredder's evaluation scores are usually correct
>>and all the rest are off!  [Everybody's out of step except Shredder].
>
>Looking at the SSDF, Shredder surely can't be doing too badly, can it?
>
>--
>GCP

Actually, GCP, you and I are talking past each other.  You are talking about
apples and I am talking about oranges.  We are each discussing a different
topic.

The SSDF tests are timed tests.  The engines are compared based on whatever
moves they can come up with in a given amount of time.

What do you suppose the results would be if each engine were allowed to reach
some preset search depth [>16] before each move?  In this proposed
[hypothetical] competition, the engines would be forced to move as soon as they
reached the required search depth but not allowed to move prior to reaching that
depth.  [As a refinement, the pre-determined depth might be set to be greater in
endgames, perhaps >18.]

In such a competition, I suspect that Crafty would come out on top of the rating
list simply because Hyatt says Crafty does very little pruning.  [This assumes
that the Crafty operator does not shut the engine off due to boredom.  : )]

Also, note my comment regarding whether or not any kind of "bias" would affect
the selection of the move.  Consider two hypothetical engines identical except
that one engine's position evaluation software gives position evaluations
exactly double those of the other.  Would you expect one engine to perform
better than the other insofar as selection of the move to play is concerned?  I
would not.  The user, however, cares about the accuracy of the evaluation score.
 Double the correct value is no good for the user.

My concern was with what the GUI displays to the user.  What happens inside the
guts of the engine is for engine programmers to consider.  I am a user and you
are a chess programmer.  ["I am a pear and you are a peach."]

Bob D.



This page took 2.69 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.