Author: Kurt Utzinger
Date: 03:19:20 10/02/04
Go up one level in this thread
On October 02, 2004 at 06:10:03, Andrey Popov wrote:
>Tourmaments are used to measure improvements of engines. However, they have some
>disadvantages.
>Firstly, it is a great and hard task to hold a big repeating tournament.
>Secondly, an improved version can take a lower place or fall into a lower
>division due to improvements of its opponents. This phenomenon disappoints
>authors and misinforms other people. Thirdly, it is impossible to use various
>versions of the same engine in one tourney because of many games.
>Some peoples arranged gauntlets. They took, say, 30 engines and hold a
>round-robin tourney. Later they add the 31th engine which plays with other 30.
>However, after, say, 200 engines each in 5 versions, they must do 1000 matches
>in order to add only one engine. Therefore they put up this hobby.
>
>I suggest another method. Probably someone already suggested it, but I doubt.
>You can choose, say, 20 (or 30) stable engines (strong and medium).
>Engines which have not free updates (e.g. Phalanx XXII, Ruffian 1.05, Pepito
>1.59) and well-known old bug-free versions (e.g. Crafty 17.14, 19.03,
>LG2000v3.5) are preferred.
>New engines and new versions play 40 (or 60) games only with these examiners.
>They do not play each other. An examined version can be erased from your hard
>disk immediately. The tournament director can choose only interesting versions
>for testing. He can make long intervals between testings because there is no
>shedule for this kind of tournaments. Every new engine needs only 40 (or 60)
>games.
>The conditions can be 5min+1s, no learning, no books(?) or something else.
>Of course, a tournament director with a computer needed :).
>What do you think about it?
If you test at 5m+1s there is no problem
in playing 1000 games -:)
Kurt
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.