Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Dangers in CC - SSDF: Terminology, Statistics

Author: Richard Pijl

Date: 15:18:21 02/21/03

Go up one level in this thread


On February 21, 2003 at 17:59:24, Rolf Tueschen wrote:

>On February 21, 2003 at 17:12:06, Richard Pijl wrote:
>
>>>Do you talk to me?
>>
>>Of course :-)
>>
>>>I have no problem with what you say. Perhaps others begin to
>>>uderstand now. You could give SSDF interesting ideas for a better testing. - But
>>>you avoided the question if Shredder is now the justified number one. What do
>>>you think.
>>
>>Number one as in best program of the world? No. It could be, but I doubt whether
>>you could _ever_ point to one program as the best or the strongest program. The
>>differences in playing strength are just too small.
>>One conclusion you could draw from the SSDF list is that is really is a strong
>>program ... when playing against other programs :-)
>>
>>Nevertheless, I welcome the effort of the SSDF in playing all those matches
>>between programs. Although you can not conclude which program is really the
>>strongest from this list, it gives a good indication on what the stronger
>>programs are. That in itself is very useful.
>>
>>Richard.
>
>
>You like these 20 games matches in autoplayer mode? What is the sense of such
>"matches"?

As the SSDF plays matches between an engine and various opponents you are
getting an impression of the strength of an engine. Just by judging it by its
results in those matches.

>What do you think of the differentiation "best" and "number one in SSDF"?

Best of what? Best in playing matches? Long time control matches? I can think of
a lot of other areas to judge an engine on. Area's like 'best analysis engine',
'best tactical monster'. In a way SSDF is just a competition. A competition that
is run with care, and with the ambition to make a world ranking. I just don't
believe that a single world ranking is possible.

So I make that distinction.

The problem is that a lot of people don't. They think the program on the top of
the list is the best one. This gives the number one position a commercial value.
So the number one position is certainly the best position to be on :-)

Richard.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.