Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: How to judge?

Author: Dann Corbit

Date: 12:38:11 12/27/99

Go up one level in this thread


On December 27, 1999 at 14:57:09, Ed Schröder wrote:
[snip]
How to know which is best?

I think Dr. Hyatt's approach is a good one -- play a bazillion games on the net
against quality opponents.  I see that Chris W. and Vincent D. have also
followed this strategy.  Since the new improvements to Rebel also allow this
kind of competition directly, I expect that you can gather a massive amount of
data with free testers at will.  You can see how a change in Rebel performs
against top computers.  You can see how a change in Rebel performs against top
humans.  I suggest you may write a parameter driven version of Rebel (or an
engine that can write personalities to disk based upon a set of criteria) and
then run one hundred games with the parameter at one setting, change the setting
and run another hundred.  Using this sort of technique, you can find out what
settings work best against various types of competition.  I think that will work
very much better than your contest, since the attempts at producing good
settings by others will be redundant and unscientific, for the most part.

By using the net as a resource, you double your compute power.  By selling
copies of Rebel that can use the net as a resource you multiply your compute
power by the number of sales (e.g. you can gather a huge number of games from
the net and calculate strengths and weaknesses against rated opponents and you
don't even have to run them).

Suggestion:
Have Rebel automatically annotate the network games with settings information so
that you can glean the effectiveness of various settings.



This page took 0.01 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.