Author: Uri Blass
Date: 07:27:38 11/10/01
Go up one level in this thread
On November 10, 2001 at 09:56:39, Thomas Mayer wrote: >Hi Uri, > >>>> The right way to compute a rating would be to take the average rating of the >>>> opponents and to count a +6 =0 -3 victory of Chess Tiger for Palm against >>>> this virtual everage player. > >>> Well, Blikskottel has about 1750-1800 ELO and the used Golem version was >>> around 1500 on those rating lists. I doubt that you would be very satisfied >>> with the rating we can calculate out of this... :) > >>We can calculate no rating based on this information because we have not stable >>rating for the program that beated palm tiger. > >oh my god, Uri, I really do not want to calculate any rating out of 9 games. It >would be unfair to ChessTiger, think about the hardware difference. I disagree. chess rating is something fair. I do not believe that your program is going to get higer ssdf rating if it plays only against programs with slower hardware. It is going to win more games but it does not mean that the rating is going to be bigger. This example >should just show that we must be vary careful what we compare when using >different hardware platforms. Is it chess strength or just computer power... >well, it is not ONLY computer power - but that does influent the results very >much... > >> I also believe that tiger earn more from time relative to the weak programs so >> we can get no idea about the ssdf rating of palm tiger based on this >> information. > >Can I quote Christophe: programmers which argument that way are searching for an >excuse of bad rating... I am not totally agree with that statement but he is not >completely wrong with it. Christophe talked about top programs. He did not talk about programs who use inferior search algorithms. Tiger has better branching factor so I expect tiger to earn more from time relative to weak programs. > >>> On the SSDF we have listed Fritz 5.0 with 2460 & Shredder 3 with 2417 on >>> Pentium 200 MHz. Well, for testing issues I use sometimes an old Pentium II >>> 233 MHz to test my own engine. Giving the better software the slower PC is >>> interesting because those better engines must win now because of positional >>> factors and can not outsearch my engine so easy. Well, but this PII/233 is >>> now to slow, Quark (current beta) scores clearly above 50% against Fritz 5 >>> and Shredder 3 on PII/233 when Quark runs on Athlon 1333... What should we >>> conclude out of that ? That Quark is over 2400 ??? I totally doubt that and >>> I am quite happy that Quark has reached maybe 2300 nowadays... Results of >>> the computer chess tourneys and on the winboard rating lists indicate that I >>> am around 2300 ELO on the fast >>> Athlon... > >> It is possible that quark(athlon) is better than 2400 against humans if you >> use fast hardware. > >believe me, it is not, not near to 2400... We need to test it in games against huamns in order to know. I believe that it is better than 2400. > >> I do not know about the winboard lists but if they are based only on comp-comp >> games I do not see how they get the 2300 when Fritz5(p200 has more than 2400 >> ssdf rating). > >It is based on winboard engines. What is so wrong with that ? No need to include >any commercials, crosscomparisson is made with Crafty, SOS & Little Goliath... It means that the rating is not comparable with the ssdf rating so the rating of the winboard is meaningless to get an estimate for the rating against humans. > >> I doubt if Fritz6(p233) can get 2400 against humans because humans have it >> when they do not have quark. > >So is the rating estimation on the SSDF-list wrong ??? Only with Fritz or also >with others ??? > >But another example, due to a lack of time I have not tested that, but I am >quite sure that it would happen that way: > >Take Quark on A1333 in the SSDF-list and let it play only against those programs >on P200 and P90 - it may end up with something over 2500, who knows... Now let >it play only against those programs with equal hardware. It will maybe end up >below 2200... So what is the right rating now ? I do not believe it. I think that you underestimate Quark. I guess that quark is going to get similiar rating in both cases and I will be surprised if it is going to get below 2200. Uri
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.