Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: The Ruffian test after 43 games by each engine

Author: Peter Skinner

Date: 22:07:08 03/02/04

Go up one level in this thread


On March 02, 2004 at 22:47:19, Chessfun wrote:

>>1. Ruffian 1.0.1 finshing within a single point of 2.1.0. Usually is happens to
>>be a .5 point differnce.
>>
>>2. Ruffian 2.0.2 and 1.0.5 seem to finish within 1 to 1.5 point of each other.
>>
>>3. Very few test results have shown 2.1.0 or 1.0.5 to be stronger than 2.0.2,
>>and 1.0.5 respectively. I know in the Ridderk tournament 1.0.5 did finish lower
>>than 1.0.1, but that was only by 4 points.. luck could have been a contributing
>>factor.
>>
>>4. When analyzing positions with those 4 versions, 2.0.2 and 1.0.5 come out to
>>the same result, just 2.0.2 does it quicker. Same goes when analyzing with
>>1.0.1/2.1.0.
>
>
>The results obtained by Manfred Meiler in the WM Test suggest differently.
>Naturally you could say that's the result of optimization or whatever.
>
>But even if that were the case the result is as you say yourself, engines that
>produces quicker results line 4. However that does clash a little with your
>lines 1 and 2.
>
>This suggestion also assumes that the engines 2.0.0. and Leiden have been dumped
>completely, despite the fact that the Leiden engine won a tournament and
>naturally could also have been a candidate for optimization.
>
>Sarah.

Actually what I said in 4. does not clash with 1 and 2.

Let's call version 1.0.1 A, 1.0.5 B, 2.0.2 C and 2.1.0 D.

If (ad) reach the same position but d finds it faster that could be due to
optimization. In almost ever tournament a and d finish within 1.5 points of each
other.. -/+.

Same can be said of versions b and c. While this proves nothing, and I have said
I hope it is not the case, in fact it could be a fact. Note it _could_ be a
fact. I have _not_ stated anything concrete.

When I read the previous post, it got me thinking so I ran a few tests and to my
surprise it was correct. Nothing more.

I find it odd, but it could be nothing more than a mind trick. I read it, so I
was looking for pre-arranged results...

When everyone was stating 1.0.1 was stronger than 1.0.5 I ran my own tests and
found them false.. atleast on my machines.. I hardly ran enough games to prove
anything concrete.

Peter.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.