Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Why not organize a Human Vs Computer Tourney at ICC?

Author: Edward Seid

Date: 19:42:32 12/13/01

Go up one level in this thread


Sometime around mid-January, I'll be running ManvsMachine(C) on ICC for the
purpose of determining the rating/ranking of various Winboard engines AGAINST
HUMAN OPPOSITION ONLY.  The details are tentative but I'll copy them here.
Suggestions would be appreciated.
--------------------

 1: MAN vs MACHINE RATING PROJECT
 2: PURPOSE: To determine the rating of various Winboard-compatible chess
engines in play versus humans on ICC.
 3: HARDWARE: 1.0 GHz AMD Athlon, 768 MB RAM, Win 2000 Pro, cable modem
connection.
 4: SOFTWARE: Winboard 4.2.3, opening book ON (if any), ponder mode ON (if any),
hashtable = 96 MB (if user specified), 3/4/5-man EGTBs (if used), all other
parameters are engine defaults.
 5: METHOD: Each engine will run for a period of 7 days (168 hours).  All games
will be 5 12 unrated blitz.  All opponents will be registered ICC human players
with established blitz ratings.  Color assignment will be random.
 6: Maximum of 4 consecutive games versus the same opponent, after which a 1
hour timeout is required.
 7: DATA: Games with no final result or <5 moves will be discarded.  The dataset
for each 7-day period will consist of 500-700 games.  All adjourned games will
be resigned at the end of each 7-day test period.
 8: RESULTS: Based on strength of human opposition and results, a rating will be
calculated for the engine.  Games and calculated rating will be made available
at http://manvsmachine.blogspot.com
 9:
10: Questions/comments about the Man vs Machine project should be addressed to
manvsmachine@winboard.info

--------------------
Changes I'll probably make are:
1- Rated games only.
2- ICC rating of engine initialized to best estimate.
3- Think about changing time control from 5 12 to the more popular 2 12.
4- Limit matches to +/- 300 points.
5- Use the final ICC blitz rating as the estimated rating of the Winboard
engine.

Thanks for all comments and suggestions.

ed seid



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.