Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: CCTF- Computer Chess Testing Foundation

Author: Karsten Bauermeister

Date: 09:42:45 06/04/98

Go up one level in this thread


I like this idea very much!
But I have some comments: It is fully impossible to test all opponents
on equal computers! To get reasonable results in a short time you need
tons of computers, and of course new ones. Then you must play with at
least 10 top-programs and many more (amateur-)programs (they are
interested in knowing, where they stand comparing to the commercial
ones!) and perhaps computers. therefore you would need many people. But
when there is a new generation of computers, you must test all programs
on these for new and throw away the "old" results? Of course not...
Something many people do not realize: It is complety irrelevant to use
identical computers for a "correct" list; the elo-system it is a
statistical system with list the player (or computers) in a relative
manner! It is only DESIRABLE to test at least all the top-programs on
top-computers to get a "half-way" correct answer to the question: "Which
program is the best?"

Perhaps it could be possible to "hire" many honored and independent
people all over the world, which add there results for a big list?!

So Bert, Ed, when there is a possibilty to get a new list for the time
after the swedish one, let's do it! We all, the programmers, the
customers and also the dealers need a list!

So my offer to all: if there will be a new list of ANY independent
organization, I would be ready both for testing and for doing some
organization.

Karsten Bauermeister



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.