Author: Pete Galati
Date: 02:38:53 04/23/00
Go up one level in this thread
On April 23, 2000 at 04:01:13, Christophe Theron wrote: >On April 22, 2000 at 19:15:20, Pete Galati wrote: > >>On April 22, 2000 at 18:27:14, Christophe Theron wrote: >> >>>On April 22, 2000 at 14:46:28, Pete Galati wrote: >>> >>>>On April 22, 2000 at 15:02:19, Chessfun wrote: >>>> >>>>>On April 22, 2000 at 14:49:59, Pete Galati wrote: >>>>> >>>>>>On April 22, 2000 at 14:20:57, A.L.Mourik wrote: >>>>>> >>>>>>>Hello dear CCC friends, >>>>>>> >>>>>>>Although earlier reports from e.g. Jouni Uski, suggest an enormous increase in >>>>>>>strenght for Crafty 17.10 >>>>>>>Nuun 2 match result Fritz6 against Crafty 17.10 ends in a very clear >>>>>>>29,5-10,5!! victory for Fritz6. >>>>>>>Played on PII 400 8mb for HT, Timecontrol 5 min + 3 sec per move. >>>>>> >>>>>>There isn't generally an enormous increase in strength from version to version >>>>>>of any program, that's unrealistic to expect there to be. >>>>>> >>>>>>Your time controls are a bit short there. >>>>>> >>>>>>Pete >>>>> >>>>> >>>>>Why didn't you say or ask that of Jouni when he posted? >>>>>as all he said was blitz, that may even have been faster >>>>>than this. >>>>>Thanks. >>>> >>>>Sorry, I don't read all posts, this one caught my eye because it was at the top >>>>of the board. >>>> >>>>If Jouni played some games this fast or faster, then my opinion would be the >>>>same, it's too fast. That isn't to say that I have not run games at that speed, >>>>I have, and they were too fast to judge the strength of a program. >>>> >>>>Pete >>> >>> >>> >>>Why? >>> >>>Can you please explain why? >>> >>>You must certainly have some evidence? >>> >>> >>> Christophe >> >>Why? Why what? Your question is far too vague. >> >>Pete > > > >Why is it too fast to judge the strength of a program? > >Give your evidence. > > > > Christophe Evidence? This is more of the perspective that you care to take than anything. But everyone will have evidence supporting their idea of how it should be done, but not all programs are going to be set up to do well in blitz games. Some well do well, some well fall flat on their face. But you allready know that if you run one tournament at 60moves/5minutes, then you run the same group of programs in a tournament of 60moves/15minutes, your outcome is going to be completely different, the order that they place will be changed. And 60/15 is still a bit fast. Again an opinion of mine, if you really want to measure the relative strength of programs, probably the only fair way to do it would be to run literally hundreds of games using many different time controls. And not just matches between the same 2 programs the whole time. There would have to be a wide assortment of programs to be able to measure the strength against. Not just Crafty and Fritz6, that's boring. Chess Tiger should probably be in there, so should Hiarcs, Junior, and whatever Rebel engine Ed's big on at the time. Now you'd be getting a reasonable measure of the program's strength because you're doing the measure against several different programs at several different time controls. But if you're going to judge a programs strength by a few blitz games, I don't think you'll have anything worthwhile, but the same goes for the blitz games that indicated that Crafty was stronger than Fritz, you just can't take it all that seriouslly, if someone's jumping up and down and claiming victory because Crafty won some games against Fritz, that's just not very realistic. Pete
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.