Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: How to evaluate progrees of computer chess programs - CM4000 X CM9000

Author: Maurizio De Leo

Date: 17:25:29 08/19/03

Go up one level in this thread


I modified the well known SSDF list just for the purpose of comparing software
improvement instead of hardware advantage. You will not find CM9000 nor CM SKR
but there it is


                          MAX     MIN    AVG
Chessmaster	3000	2428,35	2002,75	2218,55
	        4000	2627,85	2377,25	2502,05
	        5000	2646,00	2415,60	2528,80
	        6000	2752,40	2528,80	2636,60
	        8000	2678,70	2532,70	2606,20

And here there are the rules for the calculations

Only Pc programs,from the 386 onward. Every rating is normalized as if the
program had been tested on an Athlon 1200.
For every engine version the minimum possible number of conversions has been
made.
The rating gain between 2 computers is extimated as the average rating gain of
other engine versions that were tested on both harware
If no other engine versions were tested on both computers, the average rating
gain of all programs tested on both computers is used.
For every conversion it's added an uncertainity which equals the double of the
rating gain's standard deviation for those two computers.


If you are interested in the Excel file with the complete list, graphs and so
on, e-mail me.

Maurizio



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.