Computer Chess Club Archives


Search

Terms

Messages

Subject: Automatic Testing Programs

Author: Yen Art Tham

Date: 09:13:43 10/17/03

Go up one level in this thread


On October 17, 2003 at 11:54:56, Ed Schröder wrote:

>On October 17, 2003 at 11:18:43, Francesco Di Tolla wrote:
>
>>On October 17, 2003 at 06:42:03, Ed Schröder wrote:
>>>When there is something better I will provide it, but... it has to be in synch
>>>with the Windows Rebel. Providing a stronger DOS version automatically will mean
>>>a new Windows version too otherwise there will be confusion.
>>>
>>>
>>>>A better style? What do you mean?
>>>
>>>Style = Personality = Engine Parameters
>>>
>>>There still is potential in the engine parameters, I am not exactly satisfied
>>>with the current settings, it takes time to find out.
>
>>how do you procede here: I mean, I guess you are not interested in the pure
>>eng-eng competition in this research.
>>So what do you look for when you test a style? Just play and look how it behaves
>>and if you like it or you try to reproduce GM games?
>
>Hi Franz,
>
>Nowadays I do it in 3 steps, first step is manually running about 150 selected
>test positions of all kind, after this first smell of about 2½ hours I run a
>bigger automatic testset of 700 positions that produces all kind of statistics,
>makes comparisons with previous versions. If it still looks good I move the
>version in eng-eng mode, the most time consuming and boring part, takes about 4
>days. I currently have 25 test versions on this list. Go figure.
>
>After that one is still not there. Suppose from the 25 versions only 8 produce a
>somewhat better result then it doesn't mean you automatically can combine them
>because it is quite well possible that 1, 2, 3... of these 8 bite each other and
>you would endup with a weaker engine.
>
>Thus... a new process is started to find out which of the 8 candidate
>improvements can live in peace with each other. In the meantime you are 4 months
>further.
>
>This ends a chess programmers diary, take my words for it many engine
>programmers do something similar.
>
>My best,
>
>Ed


Are there any automatic testing programs available either freeware or comercial?

yat



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.