Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: You could also test it against WM-Test

Author: Thorsten Czub

Date: 14:21:53 08/27/02

Go up one level in this thread


On August 27, 2002 at 13:44:52, paul bedrey wrote:

>I notice that both XP and Century 4 score poorly in the positional part. Looks
>to me that XP has improved alot against king attack. For my part I still like
>the playing style of the Alexal personality.

maybe your observation is completely right and here lies the key to
the question: why is rebel xp (rebel.eng styling) not that good against fritz
(1-9) while different styling (you gave an exampel, we can consider other styles
too) are better: in my test games i have seen horrible moves by rebel xp against
fritz . IMO the king attack values overwrite the very good
positional values rebel had before.

with beginning of century4, and continued with rebel xp, ed schroeder
IMO made ONE mistake: he did not test against other chess programs, instead:
he implemented new stuff, in a kind of brainstorm, alone, only with himself
programming, and he did not autoplayed against other programs.

instead he tested mainly test suites (tactical stuff)
and eng versus eng.

e.g. century4 versus century3. and rebel xp versus century4.

by this method you do not realize drastical changes in behaviour against
OTHER programs.

instead you do a kind of incest testing, where your latest version
"is stronger" only in relation to your version before.

so in fact (My opinion) you do not measure progress in ELO strength but instead
progress in DIFFERENCE !

when you have "tuned" a century4 killer engine, named rebel XP, you cannot be
sure that this version really behaves stronger against fritz, or others.

IMO the new stuff he implemented works to beat century4 very good.
but thats normal. there is new stuff in it, that works different.
but it is not tuned enough concerning the general weigthings of the new
evaluation features.

you first have to set the weigthings accurate IMO.

this can only be done in testing against other programs.

it was my observation that rebel xp default is playing very ugly unpositional
games against fritz7.

the reason are the new unbalanced or untuned new features of rebel xp.

but - you can tune this.
if you do so, you can make the program much stronger.
not only in relation to century4, but in relation to all other programs.




This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.