Author: Sandro Necchi
Date: 03:49:08 07/17/05
Go up one level in this thread
On July 17, 2005 at 06:26:33, Madhavan wrote: >On July 17, 2005 at 05:22:47, Sandro Necchi wrote: > >>I have been laughing a lot (maybe crying on the ignorance would have been more >>appropriate?)reading many wrong statements about testing and Elo lists. > >So you want only list that shows good results and huge rating difference of >shredder? What has all this to do with Shredder? Pls. be serious! If you do not have arguments do not say anything. >That's why I you have been laughing a lot to put the testers down. If you laugh for what you do not understand it is your problem... > >>so, for those who are new and do not know, SSDF list is the best for the >>following reasons: >> >>1. They use 2 computers and the program complete with own book and ETG, with own >>gui and best setting as suggested by the programmer. > >No need if you want the customer who wants to test a program in his own comp It depends how you want to test it. That can make a difference. You must realize that with 2 computers the tests are more accurate. Isn't simple? If you cannot afford to have 2 computers, than it is a your problem... > >>2. They use long time controls (40/2h 20/1h; international level) only. > >people are only interested in blitz time controls,IE ask Chessmaster buyers what >time control they usually use.They would probably say 1-5 min for chessmaster >engine and infinite or 1 hour for me. Pls. use some people as most people are interested in long games and not blitz. If one hour for you is OK, it is fine for me. > >>3. They use the same hardware for all programs. >for customers,one hardware is good enough. > >>4. They use a very wide range of programs and not only the new ones to get more >>reliable results. > >20 Crafty versions? PLs. be serious (again) and take a look on the extended list to know what I am talking about. > >>5. Ponder on and learning are activated. > >No need for customers,ponder on or ponder off,doesnt matter This is ESCLUSIVELY your opinion (and of a few more others). > >> >>The use of long time controls is the best to really check the max potentiality >>of a program. It is true that the hardware used by SSDF is not updated, but 2 or >>3 times faster hardware would not change much even if some programs may benefit >>a little more than others (a small Elo difference). >> >>Some people claim better programs against humans then computers. These are pure >>lies as if you play better you play better against anybody. These are more >>"commercial" statements than true ones...of course there is no relationship on >>Elo figures on the SSDF list with those against humans, but a stronger program >>here would do better against humans too. The problem is that in order to achive >>reliable results there is a need of very many games. A few game may be >>confusing. >> >> >>Since the goal of SSDF list is to tell how strong is a new program to use the >>best settings and learning is a must too because the user can use the same and >>would like to know how strong is that program with best settings etc... >>If some programs do not have learning features and/or good ones it is their >>problem so they have to be penalized on that. The use of these options would do >>this. >> >>So, anybody can test in a different way as they wish, but to claim that system >>is better or replacing the SSDF system is pure nonsense! > > >SSDF test delays to publish the result,they take tooooooooo much break.long >break would fit. Yes, but because they want to give reliable result. I would agree with them as there are TOO MANY people which are good only to make critics and nothing else... It is not necessary to wait the new list as they are reporting in this forum the scores of the various matches, so one can understand if one version is better than a previous one after some matches. I do not think 5 or 6 points more or less makes a difference...so your statement is ridiculous. >SSDF doesn't test Fruit,still didn't test Fruit.that's irony. They will when it will be released. It seems it is strong so what is the difference if will be no. 2, 3, 4 or 5 in the list? They do not have an official book yet, so what to test? >still didn't test chessmaster ChessMaster does not have the auto232 option, so it must be tested manually and that is a problem. This option is missing because the programmer does not want to have it included, so why to do something the programmer don't want to do? Pls. think or get informed before saying things... >still didn't test many programs They are indipendent and have rules. The good think is that they nearly always (they did an exception with Fritz 5)apply the same rules to everybody! > >Testers have reported many results for the programs a day after its release. Yes, but not real data. >For customers,SSDF list is of need to them.too much delay,unfair matching of >opponents. I do not agree. Which unfair matches if all programs are playing on the same harware, best setting and same time controls? Agains get serious! > >>Sandro Sandro
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.