Author: Uri Blass
Date: 11:15:50 11/05/04
Go up one level in this thread
On November 05, 2004 at 13:04:00, George Tsavdaris wrote: >On November 05, 2004 at 12:41:29, Robert Hyatt wrote: > >>> >>>Being better than Crafty19.17 is an easy job and it seems clear that almost >>>every version of Crafty is better than 19.17. >> >>Most of what you write I tend to agree with. But not the above. I don't know >>how it "seems clear" since 19.17 is playing perfectly well on ICC all the >>time... >> >> >>> >>>There is also some evidence that 19.15 is better than 19.17 and 19.13 is better >>>than 19.17 >>> >> >> >>You can read tea leaves and make these predictions also. But it doesn't mean >>they are correct. I can guarantee you 19.13 is not better. It has _way_ too >>many glitches that were fixed. >> >> > If it has many small-bugs fixes, then to say such a thing you must be >completely sure that those fixes didn't, at any case, had any bad effect on it's >speed or in another area of it's playing ability. Are you? > > In my opinion, although i haven't made a strong comparison test, i'm very >suspicious about statements saying 19.17 is weaker based on "many" tournaments. > Until we see a huge tournament with many engines we can't really say nothing, >since the strength difference of Crafty 19.X between different X versions, MUST >be small(i assume you haven't made any magic to be bigger) so in order to >observe something important, we need really MANY games........ The fact are that in every tournament that both 19.17 and older version participates 19.17 performs worse(sometimes slightly worse and sometimes significantly worse). It suggest that the difference is not small bug big. We do not need one huge tournament and if in 7 different tournaments Crafty19.17 performs worse than previous version then it is enough evidence that there is probably a bug in 19.17. I posted links to less than 7 tournaments but I remember more tournaments when 19.17 performed worse than 19.15 or another older version when I do not remember a single tournament when 19.17 performed better than a previous version. Uri
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.