Author: Ryan B.
Date: 17:44:53 10/17/05
Go up one level in this thread
On October 17, 2005 at 17:01:25, Robert Hyatt wrote: >On October 17, 2005 at 10:10:58, Uri Blass wrote: > >>I am now surprised by the big drop in the CEGT rating of my Fruit personality. >> >>It was already 2806 after 92 games and now it is 2748 after 223 games. >> >>I also remember possible error of 61 elo after 92 games but even if the real >>rating is 61 elo lower than 2806 then I still do not expect the rating to change >>so fast. >> >>This is surprising also because results that I read earlier not by CEGT >>supported my personality. >> >>I wonder if the real error is not higher than the error that is written >> >>I wonder what is the reason for the big drop and if there was no problem in the >>matches against spike and Jonny that seem to be the main reason for the drop in >>my personality(did the same tester play these matches?). >> >>possible source of mistakes in the results. >> >>1)testing in different hardware relative to previous fruit. >> >>The claim of the CEGT is that they test with hardware that is equivalent to 2 >>ghz PIV but the problem is that there is no equivalence and it is possible that >>one program likes more one processor and not another processor. >> >>2)testing different positions and not the same positions that were tested by >>earlier version. >> >>3)testing against different opponents. >> >>Uri > > > >The standard deviation between two computer opponents is often over 200 rating >points. All you have to do is play on ICC for a while to see this happen. >Programs cycle up and down without being changed, nor having their opponents >change at all... Very true. Why is crafty only playing unrated games now by the way?
This page took 0.02 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.