Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Fair conditions?!

Author: Mike S.

Date: 01:13:54 11/01/03

Go up one level in this thread


On November 01, 2003 at 03:48:29, Sandro Necchi wrote:

>On October 31, 2003 at 20:46:18, Mike S. wrote:

>>>>(...)
>>>>Would you call it FAIR when a major competitor of yours wouldn't be tested at
>>>>all??

>(...) So, what is the rating of CM9K as really is...I mean the one you get when you
>buy it?
>It will be still unknown and different opinions will be just opinions...

This is true. As it seems now, we'll get a SSDF rating for King 3.23/SKR with
general.ctg running in the Fritz GUI. No more, no less.

(As I've written before, I'd have rather have considered to generate a simple
tree for King for this purpose.)

>Why we do not test other chess programs with different books than their book?

Because it's not necessary. The only reason that it's done with King is, that it
needs a replacement for the book the CM GUI provides (only), when used like this
in Fritz. This is done for technical reasons so to speak, not to give unfair
advantages or disadvantages.

>>It's a compromise, <<---
and therefore, not perfect.

Btw. on this occasion, do you have a comment for these results provided by a
german computerchess fan:

http://www.miko42.de/DasDuell/duellindex.html

excerpt:

Index Fritz 8.0.23 - Shredder 7.04       F8 - S7.04 % Fritz % Sh. games
-----------------------------------------------------------------------
01 eigenes Buch - eigenes Buch         131,0 - 145,0 47,5    52,5  276
12 eigenes Buch - ohne Buch            143,5 - 151,5 48,6    51,4  295
                                                            ======
(engl. own book vs. own book, or own book vs. NO book)

Without book only 1,1% less! Certainly somewhat surprising. :-)

So, what can the difference be between King with CM9000.OBK (which the opponents
most probably couldn't/didn't prepare for!), or with that old general.ctg? More
than in the comparsion Shredder without (!!) book to Shredder with your big new
S7 professional book (+1,1% only, against a similar strong opponent)? I don't
think so. A book compared to another book (both reasonable quality) can't make a
bigger difference than NO book compared to a Necchi book :-) And if you claim it
may make a bigger difference, than you'd have to explain why your book added
only 1,1% in the above match comparison.

I'd say forget it! The difference, if any, will be statistically insignificant
with the high number of games SSDF plays.

Regards,
Michael Scheidl



This page took 0.01 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.