Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Engine ELO

Author: Joshua Haglund

Date: 07:04:15 01/30/05

Go up one level in this thread


On January 30, 2005 at 06:07:30, George Sobala wrote:

>Ok, I get it. All your ELOs are derived from the Playchess server, and represent
>individual users' ELOs with their machine / engine combinations. Where exactly
>do you get this data? Please give me a url or guide me through the Playchess
>menus.
You can find it all at this link:

http://playchess.com/stats/engineranking.htm

The +/- gives you ELO RANGE of the ELO RANGE Average.

>
>However I am afraid I still believe that your approach is seriously flawed. All
>it takes is one person to play for a while with an engine on a P200 and that
>will produce a very low lower limit ELO for that engine and drag it down the
>charts. Furthermore people playing with expensive top-end machines are generally
>power-mad and rating-hungry and are very unlikely to play games with engines
>below the top five. So weaker engines rarely get the benefit of top hardware.
>
I doubt it's flawed, I hope everyone tries to prove it is. The ELO Range
averages change everyday, it goes up and down. playing 5000 games yourself isn't
going to change anything. If there was a flaw it would have shown up by now,
approaching 3 million games.

It would take a lot more then one person to make a ELO RANGE Average go down.
The other (example) 500 users of The King 3.33 would have to stop playing all
together. On the other hand, if he renamed his engine to The King 3.33_200mhz,
His rating would appear on the list after 5000 games. This is shown in the ELO
RANGE. The King 3.33 2513-2543  ELO RANGE Average of 2528 +/- 15.

>However you may get slightly more meaningful statistics by introducing a lower
>limit of number of users for each engine:

e.g. only allow it into the charts if
>at least 40 different people have each played more than 50 games with it. That
>would tend to average out the hardware strength a bit better.

2000 games is shown at the playchess.com link above. However, it doesn't give
you a range until 5000 games. It's not as accurate at 2k games either.

>I don't know
>whether you can do that with the raw data available.

No I cannot do what with the data.

Joshua Haglund
toneewa@yahoo.com



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.