Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Jeff Sonas' proposal for an improved rating system

Author: Antonio Dieguez

Date: 20:39:59 02/14/03

Go up one level in this thread


On February 13, 2003 at 19:10:00, Dave Gomboc wrote:

>On February 09, 2003 at 01:04:41, Antonio Dieguez wrote:
>
>>On February 08, 2003 at 06:28:00, Dave Gomboc wrote:
>>
>>>On February 08, 2003 at 03:30:34, Peter Kappler wrote:
>>>
>>>>
>>>>He has some good ideas.
>>>>
>>>>http://www.worldchessrating.com/521683950.html?529637011233717
>>>>
>>>>-Peter
>>>
>>>The one thing that always bugs me about Sonas's stuff is that he takes the data,
>>>does some fitting on it, then says "see, this fits the data better!".  Well, of
>>>course it does!
>>
>>yes and that's good. "Some fitting", you are being despective with the way he
>>does it. I don't see anything so weird or so senseless.
>>
>>Let imagine if I only tune the K factor with real data instead of no data. If I
>>do that, I wonder who can't believe that's no good. And so on with a few other
>>things. If there were a sound theory behind dictaminating wich should be the
>>best k then it is other thing though.
>>
>>> What he should do is have training data that is *distinct* from
>>>his testing data, e.g. tune his formulae on results from (for example)
>>>1990-1995, then test on (for example) 1996-2000.
>>
>>and after test and correct, end up with the same thing... just kidding
>>
>>> Tuning on 1990-2000, then
>>>testing on 1990-2000 is bogus.
>>
>>he is tuning on 1990-2000 and betting it will work better for other periods.
>
>Yeah, he's betting on it, but he can't show it.  Why?  Because he has no other
>data!  If he was being scientific, he's split his training data from his test
>data, then he'd be able to show that his technique has predictive power into the
>future.

Anyway, if someone trains with half of the data, and then tests with the other
half, and it doesn't work well for him, then he would not show the results. He
would only show that results if it works ok, so he would be training with the
whole data actually :)
Ok am just semijoking with that last, I also think it would be nice that he
makes reasoning with part of the data and then says hey! it works for the
rest...



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.