Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Comparison of RATING LISTS

Author: Jeff Lischer

Date: 08:50:32 01/05/06

Go up one level in this thread


On January 05, 2006 at 09:09:33, Maurizio De Leo wrote:

>On January 04, 2006 at 16:16:44, Jeff Lischer wrote:
>
>>>www.deleosorice.altervista.org/altro/comparison.jpg
>>>
>>>As I tought the rating lists are very reliable and there are only a few cases
>>>where the error ranges are incompatible.
>>>
>>>Maurizio
>>
>>Thanks for the chart! It's nice to see the various lists agreeing with each
>>other. From a quick glance at the chart, however, it looks to me like the KURT
>>ratings are pretty consistently 25-100 points below the others. How did you
>>optimize the scaling from list to list?
>
>I scaled the rating so that every list had the same average than Kurt's list
>when considering only engines present in both. I could put up the excel file I
>used if you want.
>It may be that for some lists the overlap with Kurt's list is small, so the
>scaling is skewed. What method would you suggest using ?
>
>Best Regards
>Maurizio

I probably would have tried scaling the ratings like you did. It's strange that
you used Kurt's list to scale all the results and yet that's the one that looks
low to me! Maybe minimizing the "sum of squares" would be better than simply
making the averages the same. I'd be happy to take a look at your excel file and
let you know if I can think of anything better. In the meanwhile, I'll take a
closer look at the chart to see if I'm missing something.

Best Regards,
Jeff



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.