Author: Igor Gorelikov
Date: 01:06:01 10/22/02
Ruffian at different time controls and hardware (results and conclusions)
-------------------------------------------------------------------------
I have tested Ruffian 1.0.0 at different time controls on two
computers (slow and fast).
I ran a series of Ruffian's 20-games matches vs well-known free top
engines: Yace 0.99.56 and Crafty (ver. 16.19, 18.15, and 19.0 DC).
<pre>
Section 1. On slow hardware (P1 133MHZ 32MB)
=============================================
Yace 0.99.56 vs Ruffian
Time Control Yace Diff Notes
-------------------------------------------------------------------
5'+3" 8.5-11.5 -3 Ruffian is a little bit better
15'+3" 8.0-12.0 -4 Ruffian is better
30'+3" 9.0-11.0 -2 Ruffian is a little bit better
60'+3" 3.5-15.5 -12 Oops! But continue...
120'+3" 8.5-11.5 -3 Ruffian is a little bit better
Crafty 16.19 vs Ruffian
Time Control Crafty's score Diff Notes
-------------------------------------------------------------------
5'+3" 7.5-12.5 -5 Ruffian is better
15'+3" 7.0-13.0 -6 Ruffian is better
30'+3" 5.5-14.5 -9 Oops!
60'+3" 6.5-13.5 -7 Ruffian is much more better
120'+3" 6.0-14.0 -8 Ruffian is much more better
Conclusion: Ruffian is much more strongter than Crafty 16.19 on slow
hardware at any time control.
Crafty 18.15 vs Ruffian
Time Control Crafty's score Diff Notes
-------------------------------------------------------------------
5'+3" 7.5-12.5 -5 Ruffian is better
15'+3" 8.5-11.5 -3 Ruffian is a little bit better
30'+3" 7.0-13.0 -6 Ruffian is better
60'+3" 8.5-11.5 -3 Ruffian is a little bit better
120'+3" 6.5-13.5 -7 Ruffian is much more better
Section 2. On fast hardware (P3 1GHz 256MB)
============================================
Time Control Yace 0.99.56 Diff Notes
----------------------------------------------------------
5'+3" 7.5-12.5 -5 Ruffian is better
15'+3" 8.5-11.5 -4 Ruffian is better
30'+3" 4.5-15.5 -11 Oops!
80'+3" 7.0-13.0 -6 Ruffian is better
Time Control Crafty 16.19 Diff Notes
----------------------------------------------------------
5'+3" 10.0-10.0 0 They are equal!
15'+3" 6.5-13.5 -5 Ruffian is better
30'+3" 9.0-11.0 -2 Ruffian is a little bit better
80'+3" 5.5-14.5 -9 Ruffian is much more better
You may see that Yace plays weak vs Ruffian at 30'+3" while Crafty 16.19
quite well.
To compare their strengh, let's run a match between them at the time
control of interest.
Time control: 30'+3"
20-game match
P3 1GHz 256MB, 2002.10.04 - 2002.10.07
Score 12345678901234567890
---------------------------------------------------
1: Yace 0.99.56 11.0 / 20 =1110011010=0101=0=1
2: Crafty 16.19 9.0 / 20 =0001100101=1010=1=0
---------------------------------------------------
20 games: +12 =4 -4
Conclusion: There is no great difference between them!
So that time control favours only one particular engine (Ruffian, for
instance) vs another particular engine (Yace 0.99.56, for instance).
Time Control Crafty 19.0 DC Diff Notes
------------------------------------------------------
5'+3" 13.0-19.0 -6 (32 games) Ruffian is better
15'+3" 4.5-15.5 -11 Oops! But continue...
30'+3" 8.5-11.5 -3 Ruffian is a little bit better
80'+3" 9.0-11.0 -2 Ruffian is a little bit better
Section 3. My conclusions
==========================
</pre>
In general, Ruffian is stronger than Yace 0.99.56 and Crafty (16.19,
18.15, 19.0 DC).
It won all matches but one which was drawn.
There are time controls that favours one particular engine more than the
other particular engine. So if you fall into it arranging a casual match
you may get amazing results!
Best regards,
Igor
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.