Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Computer Chess Rating Lists (CCRL)

Author: George Tsavdaris

Date: 04:21:54 01/05/06

Go up one level in this thread


On January 05, 2006 at 05:46:31, Chessfun wrote:

>
>
>A new group has been formed for testing chess engines. The aim is not to compete
>with any other groups of testers but simply produce our ratings for the benefit
>of the community at large.
>
>The group CCRL (Computer Chess Rating Lists) currently consists of Graham Banks,
>Ray Banks, Sarah Bird, Kirill Kryukov, Charles Smith.

 I don't know the reasons you've sheered away from CEGT and i would like to know
what different philoshopy of testing means(an explanation i heard), but anyway i
hope you good luck and happy testing!

>
>Testing of engines shall take place at 40 moves in 40 minutes repeating on equal
>to AMD 3800+. And at 40 moves in 8 minutes based on the same AMD 3800+. Using
>generic engine books.

 That is shame in my opinion. Of course is a matter of taste and personally, i
always prefer own engine books to be used! I don't understand why most lists
doesn't use own engine books and instead use some general books or position
sets?!?!? That's why i like SSDF(not only for that of course).
 Of course when using general books, the list is again interesting to watch, so
that new list will be interesting to follow too.....!

 Also by using a really good, for the following purpose generic book, is good to
measure the pure engine's strength in general, that is in all kind of
situations.  But this perhaps, may lead to wrong conclusions.
 For example let's say your list with a general book shows Engine-A is better
with +60 ELO from Engine-B. Now someone may believe that Engine-A is a lot
stronger than Engine-B in general. But perhaps if Engine-B plays with its own
book, then there is the possibility Engine-A(that plays with the generic book)
to be even worse than engine-B. Also there is the possibility Engine-A even if
it played with its own book to be again worse than Engine-B that plays with its
own book.
 I've put a "perhaps" in all these, as no one so far has proven such a thing,
but also no one has proven the opposite.....

>
>Obviously with the given speed and time controls it will take some time to
>establish a reliable list but currently as a group we share 16 PC's
>
>The groups first published list will appear early Feb 2006, members may choose
>to post games here from time to time.
>

Any link? Is the http://kd.lab.nig.ac.jp/chess/engine-tourney/
the correct one.....?



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.