Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: The Ruffian test after 43 games by each engine

Author: Peter Skinner

Date: 17:37:00 03/01/04

Go up one level in this thread


On March 01, 2004 at 15:10:56, Dann Corbit wrote:

>
> # Name              1    2    3    4    5    6    7    8    9   10   11   12
>13   14   Score   Buch  Sommb
>-------------------------------------------------------------------------------------------------------------
> 1 Ruffian_202    **** =1=  01=  =01  =10  0==1 1=0  11=1 111  111  11=  1110
>0=1  1=11  30.0/43 882.5 595.50
> 2 Ruffian_105    =0=  **** 1=0  ===  ==1  =11  1111 111  1010 001= =01  =10
>1111 111   29.0/43 892.5 574.00
> 3 Ruffian_210    10=  0=1  **** 1=0  =001 ==0  011= 110  1=11 0001 110  1=1
>111  111   26.5/43 910.0 526.25
> 4 Ruffian_101    =10  ===  0=1  **** ===  00=  1=1  101= 101  0101 1110 111
>01=1 101   26.0/43 898.5 524.75

This is almost bang on with the results that I have attained. Version 1.0.1 in
my testing finished ahead of 2.1.0 by only a half point. So those two just
flopped in our testing.

My games we G/15 and G/30. It seems that Ruffian 1.0.5 and 2.0.2 are just about
equal in strength and 1.0.1 and 2.1.0 are equal in strength.

I read a post on another forum the other day where someone did some more in
depth testing is came to the conclusion that it is possible that 1.0.1 has been
optimized and renamed 2.1.0 and the same goes for 2.0.2 and 1.0.5.

If you take certain test positions and analyze them with the two similiar
versions almost 99% of the time the same variation happens. If there was a
"huge" strength improvement like some would have us believe that would not be
the case.

Unfortunately the post was removed as the administrator felt the post was
attacking the author or accusing his of fraud. While the poster probably was,
there is a hint that this is exactly what could have happened.

Statistics do not lie...

Peter



This page took 0.01 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.