Computer Chess Club Archives


Search

Terms

Messages

Subject: How to setup fair and reasonable enginematches?

Author: Joachim Rang

Date: 11:40:06 07/25/02


I'm going to make some automatches between amateur engines. As this is the first
time I try to make this, I'd be glad to get some advices.

I will use a PIII-Notebook at 1.1 GHz with 256 MB RAM. I plan to make not a
tournament but one to one matches with much games (a few hundreds) to get
significant results.

What are fair and reasonable testconditions?

I will run the match on PIII 1.1 GHz and 256 MB RAM under WinXP. I think its
reasonable to give every engine 80 MB Hashtablesize. I still don't know which
GUI I shall use. I tested Arena and it worked, but with some problems. With
Winboard I don't know how to make automatches, maybe someone can help?

First engine will be Yace 0.99.56, which I consider the strongest amateurengine
today.
Which engine can compete with Yace?

I think I will run the games with 10 minutes and 10 s per move for each engine.
Is this to short?

Another question is, which opening books I shall use. Yace has an own book as
most of the other engines. But I don't know how good they are, SOS for example
comes only with a very little own book, which will be a handicap. Does someone
know a "neutral" but large book, which will run with the most engines?

So far today, I'd appreciate any suggestions from you.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.