Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Automatic Testing Programs

Author: Ed Schröder

Date: 09:54:42 10/17/03

Go up one level in this thread


On October 17, 2003 at 12:13:43, Yen Art Tham wrote:

>On October 17, 2003 at 11:54:56, Ed Schröder wrote:
>
>>On October 17, 2003 at 11:18:43, Francesco Di Tolla wrote:
>>
>>>On October 17, 2003 at 06:42:03, Ed Schröder wrote:
>>>>When there is something better I will provide it, but... it has to be in synch
>>>>with the Windows Rebel. Providing a stronger DOS version automatically will mean
>>>>a new Windows version too otherwise there will be confusion.
>>>>
>>>>
>>>>>A better style? What do you mean?
>>>>
>>>>Style = Personality = Engine Parameters
>>>>
>>>>There still is potential in the engine parameters, I am not exactly satisfied
>>>>with the current settings, it takes time to find out.
>>
>>>how do you procede here: I mean, I guess you are not interested in the pure
>>>eng-eng competition in this research.
>>>So what do you look for when you test a style? Just play and look how it behaves
>>>and if you like it or you try to reproduce GM games?
>>
>>Hi Franz,
>>
>>Nowadays I do it in 3 steps, first step is manually running about 150 selected
>>test positions of all kind, after this first smell of about 2½ hours I run a
>>bigger automatic testset of 700 positions that produces all kind of statistics,
>>makes comparisons with previous versions. If it still looks good I move the
>>version in eng-eng mode, the most time consuming and boring part, takes about 4
>>days. I currently have 25 test versions on this list. Go figure.
>>
>>After that one is still not there. Suppose from the 25 versions only 8 produce a
>>somewhat better result then it doesn't mean you automatically can combine them
>>because it is quite well possible that 1, 2, 3... of these 8 bite each other and
>>you would endup with a weaker engine.
>>
>>Thus... a new process is started to find out which of the 8 candidate
>>improvements can live in peace with each other. In the meantime you are 4 months
>>further.
>>
>>This ends a chess programmers diary, take my words for it many engine
>>programmers do something similar.
>>
>>My best,
>>
>>Ed

>Are there any automatic testing programs available either freeware or comercial?

It is my_ware.

Ed




This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.