Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Are over-optimistically evaluations stronger than realistic evaluati

Author: Drexel,Michael

Date: 02:51:37 04/30/03

Go up one level in this thread


On April 29, 2003 at 18:12:38, Uri Blass wrote:

>On April 29, 2003 at 17:11:16, Amir Ban wrote:
>
>>On April 29, 2003 at 16:25:42, Uri Blass wrote:
>>
>>>On April 29, 2003 at 15:17:32, Amir Ban wrote:
>>>
>>>>On April 28, 2003 at 11:30:08, Charles Worthington wrote:
>>>>
>>>>>That's an interesting question but I have one of my own. Is not the engine's
>>>>>choice of continuations based soley on its eval of the line? Many times I have
>>>>>seen Shredder follow its over optimistic evals to a dead draw as white. I would
>>>>>rather my program know where it really stands and whether or not it has
>>>>>realistic winning chances. Also...I personally would like to know where it
>>>>>stands as well. There is nothing quite so frustrating as to have an over
>>>>>optimistic eval turn on you and bite you. I have seen numerous situations where
>>>>>The King has an eval of +2 against Deep Fritz's -1 and it RARELY works out in
>>>>>The Kings favor. It's hard for me to muster faith in an engine that is clueless
>>>>>about it's own position and it is the one thing that keeps me from giving
>>>>>Shredder a fair shot at becoming my main engine. Enough times of seeing Fritz
>>>>>pull the rug out from under my Shredder eval has spooked me I guess. I just do
>>>>>not see how it is possible to handle a position properly when you cannot even
>>>>>eval it properly and in fast blitz time controls (3+2), I might also add that
>>>>>the "optimistic" engines almost always perform more poorly than the well
>>>>>balanced engines. The truth seems to perform better than the lie in this case.
>>>>>Of course this discussion is about self-inflicted optimism by tampering with the
>>>>>parameters so it seems even more extreme. You are taking an already-optimistic
>>>>>engine and furthering it's optimism. It would likely take many thousands of
>>>>>games to come to a conclusion as to which works best. Honestly though, I think
>>>>>that in this case having your program lie to you (and itself) will not prove
>>>>>beneficial. The program will play better if it has a full understanding of its
>>>>>actual chances and not imagined ones...Optimism causes the program to
>>>>>overestimate it's chances and play far too aggressively (ie. unwarranted
>>>>>sacrifices) in certain positions where caution is warranted. Against a human
>>>>>this may prove beneficial but against a program firmly grounded in reality it
>>>>>may prove fatal. So, like in life, I think the truth has to be better than the
>>>>>lie. And I think that extensive testing of these settings would show that, more
>>>>>often than not, the lie would come back to bite you.
>>>>>
>>>>
>>>>I agree.
>>>>
>>>>I believe overvaluation is the most common reason for engine losses. It's much
>>>>more common than undervaluation, a less fatal problem. This is especially true
>>>>in tactical situations, where the program with overvaluation seems not to see
>>>>tactics, because its search is meaningless.
>>>>
>>>>Amir
>>>
>>>1)What is overevaluation
>>>Do you mean positional score that is too high or only being too optimistic?
>>>
>>
>>I don't really see the difference. I prefer the term "overvaluation" over
>>"optimistic" (or maybe "bluffing") because the latter creates the illusion that
>>the program knows what's right and consiciously distorts it.
>
>All the discussion started from that idea to consiciously distort the true.
>
>The point is that if your program has a relative advantage against other
>opponents in the middle game and not in the endgame then it is better for it not
>to trade pieces if it does not have to do it.
>
>The idea was in that case to evaluate your pieces as slightly better than the
>opponent pieces with the exception of inferior positions.
>
>It is possible to do part of it by changing parameters in chessmaster and the
>problem is that it is not possible to tell chessmaster about the exception by
>only changing parameters.
>
>Uri

That is the point. I created a personality for Chessmaster which beats
Chessmaster SKR +37 =42 -21 and Grailmaster 7 +35 =40 -25 in 5 min blitz.
It is very strong in open middle game positions.
The drawback is: Now it cant compete against Shredder 7.04 anymore because
it is very weak in the endgame.
Either Johan de Koning dont care much about playing strength of his program or
he has weak test methods because the default settings are relatively weak
at all time controls.

Its nice that you can change the parameters.
However the possibility to setup different settings for different types of
positions would be necessary to make the program much better if their default
setting is obviously not the strongest.

Michael








This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.