Author: Dann Corbit
Date: 12:35:17 01/28/05
Go up one level in this thread
On January 28, 2005 at 04:49:54, Stefan Meyer-Kahlen wrote: >On January 28, 2005 at 02:36:23, Harald Faber wrote: >>On January 28, 2005 at 01:49:29, Sandro Necchi wrote: >>>How much stronger is it? >>>This time I will leave the fun to find out to you!:-)) >>> >>>Ciao >>>Sandro >> >> >>How many ELOs did you say is Shredder 8 stronger than 7.04? How many ELOs can we >>see for real (SSDF)? ;) > >These questions are probably the reasons why you don't get any Elo expectations >from Sandro for Shredder 9, at least this is why you don't get any guess from >me. > >You know that exact Elo numbers are very hard to measure, when you get a number >from Sandro, it is a value according to his tests and experience, not a number >which is based on marketing. Sandro is one of the most honest people I know, he >would never tell you something which he doesn't believe is true. > >If your Elo guess is wrong, even years later people will remind you of this >accusing you (directly or indirectly) of not telling the truth. This has >happened many times in the past and is hard and annoying to deal with. > >Shredder9 will be out very soon and you will get many results of it from >independent testers quickly. You can chose which one to trust and if you like >what you hear. > >Of course according to our belive Shredder has been imporved, otherwise we >wouldn't have released it. I think that this is the only logical approach. You can do lots of testing and get your best approximation of the Elo of a new product. But it would cost a staggering sum of money to do the testing that the SSDF does for free, and it would be very hard to equal the quality of that testing. Now, suppose that you did your own testing on the same scale as the SSDF -- with 1000 games against a broad array of opponents. Will others believe it? "Hah! They obviously have an axe to grind! My favorite engine CrushMonster would have fared much better under a fair test!" And so I think that Elo expections are best left to, "I think we have improved it." From the clear domination of Shredder over everything else for the past few years, all I can say is -- whatever you have been doing, keep doing it.
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.