Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: New SSDF list

Author: Fernando Villegas

Date: 16:46:52 11/27/99

Go up one level in this thread


On November 27, 1999 at 17:33:13, Robert Hyatt wrote:

>On November 27, 1999 at 12:18:07, Fernando Villegas wrote:
>
>>I do not understand your point, Bob. This is not a match between two computers,
>>but many. How a program could do well just tuning against Tiger? Maybe that
>>could mean to un-tune against any other of the concurrence. Maybe some opening
>>preparations, but...
>>Fernando
>
>
>This is easy.  A year ago, due to some unusual new eval features I added, I
>ended up with a version that had very little trouble with Fritz 5 at any time
>control.  It won so many games that Lonnie accused me of using a Cray to play
>against him.  If I sent _that_ version to the SSDF for testing, it would have
>done very well against fritz, because fritz would be totally unprepared.  But
>once they saw what was happening, some adjusting on their end (king safety and
>passed pawns in particular) and this advantage would have eyvaporated.
>
>Almost always the _last released_ program goes to the top of the SSDF.  In this
>case, it is an _unreleased_ version, which means _nobody_ had a chance to look
>at the book, and the depth, at the evals, and find out what it is doing....
>
>Sort of an "element of surprise"...


Please let me clear this issue a little more.
a) SSDF testing is not made by the programmers so they couldn't tune his
programs according to every new opponent.
b)Being so, if, let us say, anyway F6 is delivered to the swedish people after
being tuned against Tiger 12, my question is, what would happen to F6 against
other programs? Why tunning against program X neccesarily means the likelihood
to get more points in a pool constituted by many opponents different to X?
c) That is the core of my question and the only way I found to understand your
point is to suppose that Tiger 12 brings not only some specific features that
could be anulated so and so, but general, universal improvements so if you tune
againts them, you improve your own program "in general"
d) In this way, tunning againts Tiger 12 would means tunning against any other
program.
e) If that is not the case, I still believe that in a tournament where you face
many different opponents, just to prepare againts one of them could means a
worst general result, at least you can do the same thing before every game, but
we already know you cannot do.
Sorry is this seems a little bit confused. It is :-)
Fernando



This page took 0.01 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.