Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Does anyone have Crafty vs. other engines blitz statistics?

Author: James T. Walker

Date: 08:50:31 02/19/03

Go up one level in this thread


On February 19, 2003 at 11:12:37, Roy Brunjes wrote:

>On February 19, 2003 at 00:50:04, James T. Walker wrote:
>
>>On February 18, 2003 at 22:57:47, Charles Worthington wrote:
>>
>>>I am cosidering making Crafty my primary engine for 3+2 and under games on the
>>>chessbase server. Does anyone have blitz stats (ie. w-l-d) for crafty vs various
>>>other engines?
>>
>>In my opinion Crafty is not a good blitzer.  It appears to me that Crafty has
>>become better at longer time controls and worse at short time controls in the
>>last few years.  The only info I have on Crafty is for Crafty 18.13 which scored
>>101 out of 278 games at G/5min vs various top programs in my blitz database.  I
>>have Crafty 19.01 scoreing only 37.5 out of 100 games vs Deep Sjeng Beta on 2
>>XP2400+ machines using auto232 (G/5min).  I don't own a dual.
>>Jim
>
>Hmm... 101/278 is roughly 36.3 percent for Crafty 18.13.  That is not even as
>good as the 37.5 points that Crafty 19.01 has.  Granted, the sample size is much
>smaller for 19.01 than for 18.13, but is that data sufficient to clearly declare
>18.13 as better at blitz?
>
>Roy

Hello Roy,
No, of course not.  My opinion is based on my experience with my database and
results seen here.  You have to consider the results for 19.01 were only against
one opponent.  The 18.13 results was vs some of the top engines of today.
I also have played other crafty versions vs several beta engines and these test
are only in my mind since I did not save the beta engine games when I was not
sure it was the final version.  I'm not saying my opinion is "proof" or
scientific.  It's only my opinion based on my experience.  Others have different
opinions based on different experiences.  Nothing wrong with that.
Also I did not mean to say that Crafty 19 is worse than Crafty 16 at blitz.
What I mean is that while Crafty is getting better all the time it seems to me
that at blitz speed it's falling further behind the top engines of today
compared to where it was several years ago.  An engines particular spot on my
database depends a _l_0_t  on it's opponents and the number of games played.
It's very easy to manipulate a database to make a single program go up or down.
This can be done intentionally or unintentionally.  Here is some of the standing
of Crafty on my database list.

#     Program     Games
31. Crafty 18.10 124 games
34. Crafty 19.00  90 games
36. Crafty 18.13 278 games
43. Crafty 18.3   42 games
46. Crafty 19.01 100 games

The obvious problem here is the number of games is small.  The opponents are not
taken into account except by the rating formula.  So the small number of games
makes the particular places on the list very unreliable.  That leaves me with
only my impression based on my experience.
Jim



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.