Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Differing opinions: Hiarcs and Crafty

Author: Ralf Elvsén

Date: 12:44:15 08/29/99

Go up one level in this thread


On August 29, 1999 at 14:20:16, Mark Young wrote:

>On August 29, 1999 at 13:30:20, Robert Hyatt wrote:
>
>>On August 29, 1999 at 12:36:18, Ralf Elvsén wrote:
>>
>>>This is a position from a game Hiarcs 7.32 - Crafty 16.6
>>>Time 25 min/game, ChessBase interface etc, but that is not
>>>important.
>>>
>>>6k1/1p4p1/p7/2Ppp3/1P6/P4KP1/5P1P/8 b - - 0 49
>>>
>>>What is interesting is that Crafty (black)
>>>thinks the position is about even, with a score fluctuating
>>>around equality, while Hiarcs for several plies
>>>has realized that it has a won position and
>>>has a score about +2 (an exchange of rooks has just
>>>taken place some plies ago).
>>>
>>>I checked 16.6 as a winboard engine, also 16.16:
>>>same result.
>>>
>>>This is a serious mis-evaluation of
>>>the pawn structure since white easily can produce
>>>passed pawns on both sides of the board, while
>>>blacks connected free pawns can do nothing.
>>>
>>>Bob, maybe you want to look into this...
>>>
>>>
>>>Regards, Ralf
>>
>>
>>This is a bit speculative by hiarcs...  ie I have seen it do this same sort
>>of evaluation and be dead wrong as well...
>>
>>the only thing I don't evaluate at present is pawn majorities which turn into
>>distant passed pawns.  It is on my todo list, and I have some code written that
>>does pretty well but is not ready for testing on the servers yet...
>>
>>My version of crafty (16.17 as released) thinks black is worse here, by about
>>1/3 of a pawn...  and as it advances pawns to make passed pawns, this gets
>>worse.  But there is always danger in these positions... and I only hope that
>>I get more right than wrong...  however, +2 here?  Seems hard to fathom...
>
>I don't know if this is a case of specuation by Hiarcs or something else. I did
>test some other programs on this position and they tend to agree with Hiarcs
>7.32.
>
>5 min search.
>
>Crafty 16.13  Fritz 5  Junior 5  Hiarcs 6  Hiarcs 7.32
>
>  +/= .43     +- 1.56  +- 2.07    +- 2.16   +- 2.23

Not being a programmer myself I can only guess what is going on.
If Crafty gives a big bonus to blacks passed pawns and doesn't
consider whites potential, then that is incorrect in this case.
However, I guess a program can give the "correct" score for
different reasons:

1. A correct evaluation of the pawn structure. I can
imagine that it is not easy to include this in the
evaluation function.

2. The obvious fact that black is one pawn up is heavily
weighted due to the fact that it is a pawn ending, where this
usually is extremely important. This can however give
erroneous results in other situations.

Maybe one could do some testing on similar positions to
find out how the programs "think". Unfortunately there
are not many programmers who seem to have time to comment
on things like this (understandably).
Credit to Bob.

Ralf



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.