Author: Andrey Popov
Date: 03:10:03 10/02/04
Tourmaments are used to measure improvements of engines. However, they have some disadvantages. Firstly, it is a great and hard task to hold a big repeating tournament. Secondly, an improved version can take a lower place or fall into a lower division due to improvements of its opponents. This phenomenon disappoints authors and misinforms other people. Thirdly, it is impossible to use various versions of the same engine in one tourney because of many games. Some peoples arranged gauntlets. They took, say, 30 engines and hold a round-robin tourney. Later they add the 31th engine which plays with other 30. However, after, say, 200 engines each in 5 versions, they must do 1000 matches in order to add only one engine. Therefore they put up this hobby. I suggest another method. Probably someone already suggested it, but I doubt. You can choose, say, 20 (or 30) stable engines (strong and medium). Engines which have not free updates (e.g. Phalanx XXII, Ruffian 1.05, Pepito 1.59) and well-known old bug-free versions (e.g. Crafty 17.14, 19.03, LG2000v3.5) are preferred. New engines and new versions play 40 (or 60) games only with these examiners. They do not play each other. An examined version can be erased from your hard disk immediately. The tournament director can choose only interesting versions for testing. He can make long intervals between testings because there is no shedule for this kind of tournaments. Every new engine needs only 40 (or 60) games. The conditions can be 5min+1s, no learning, no books(?) or something else. Of course, a tournament director with a computer needed :). What do you think about it?
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.