Computer Chess Club Archives


Search

Terms

Messages

Subject: An idea for ranking of chess programs

Author: Uri Blass

Date: 00:51:33 12/18/05


My idea is the following:

decide that some weak program has rank 0.
Choose hardware and time control.

play the Noomen match between every 2 programs(this match has 100 games).

Every program that score more than 60% against the weak program that you choose
in the Noomen match is at least rank 1.

If they cannot score more than 60% against programs with rank 1 they have
exactly rank 1.

You can see that I defined the programs with rank 1 and the programs with rank
higher than 1.

Suppose I defined the meaning of programs with rank n and programs with higher
ranking than n.
programs with rank n+1 are programs that scored more than 60% against at least 1
program with rank n but did not score more than 60% against all the programs
with rank that is higher than n.

Not that this definition is meaningful only if the ratio is transitive and we
need that to have that if A gets more than 60% against B and B gets more than
60% against C then C cannot get more than 60% against A.

What is your opinion?

Is 60% from 100 games in the Noomen match high enough or do we need more than
60%?

Uri



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.