Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Chess program similarity experiment (Results)

Author: Robert Hyatt

Date: 12:56:40 01/28/99

Go up one level in this thread


On January 28, 1999 at 13:26:47, Bruce Moreland wrote:

note that some of the positions end up in tablebases.  I don't know what they
used, but I used none, because of the format change from 15.20 to 16.0.  As a
result, I ran with no tablebase hits possible...

If someone has a PII/400 they can run on, I can run crafty on one processor at
1 minute per position, and they could run bionic the same way.  A PII/400 and
my xeon/400 are close to the same speed.  that would be the best comparison
unless one person wants to run both bionic _and_ wcrafty_15.20.exe (from my
ftp site) on the same box, which would be even better...

I'd much prefer that to eliminate all variables.  the SMP code produces some
odd results at times, and my linux version is 15% slower than the corresponding
windows executable due to MSVC being a better compiler.  All in all, too many
different things...



>I have some results for Crafty 15.20.  It looks a little more like Bionic than
>other programs do, except for Bionic itself.
>
>This may be because of the faster processor.  I'd stil like to see runs for the
>version that Bionic was based on, and I think it would make sense to do a run
>with Crafty on something slower, perhaps Bionic on something faster, and I'll
>try to run mine on something faster as well.  I also want to get the rest of
>Bob's 15.20 run, to see how well it matches versus the opponents.
>
>This test is going to have problems because of the different processor types,
>but I still think I'd rather be able to compare a P6/200 at one minute versus a
>Xeon 450 x 4 at one minute, rather than running the P6/200 for 8 minutes or the
>quad Xeon for 8 seconds.
>
>bruce
>
>--------------------
>
>                  Ferret     Exchess    Amateur    Zarkov
>                  v 546      v 2.53     v 0.9h     v 4.5c
>                  P6/200     Cel/400    G3/300     P2/300
>                  49mb       24mb                  2mb
>       Rd Total
>Bionic  1   60    36  60%    34  57%    33  55%    33  55%
>        2   38    12  32%    13  34%    11  29%    10  26%
>        3   30    22  73%    22  73%    23  77%    26  87%
>        4   40    27  68%    25  63%    27  68%    30  75%
>        5   17    15  88%    10  59%     9  53%    13  76%
>        6   44    29  66%    32  73%    29  66%    30  68%
>        7   53    28  53%    31  58%    30  57%    29  55%
>        8   47    28  60%    23  49%    26  55%    30  64%
>        9   32    26  81%    25  78%    24  75%    25  78%
>       10   22    16  73%    16  73%    17  77%    18  82%
>       11   22    16  73%    12  55%    14  64%    16  73%
>           405   255  63%   243  60%   243  60%   260  64%
>
>Opp.    1   60    30  50%    24  40%    16  27%    20  33%
>        2   38    14  37%    11  29%    12  32%    22  58%
>        3   30    20  67%    24  80%    16  53%    17  57%
>        4   39    18  46%    15  38%    16  41%    23  59%
>        5   17    12  71%     9  53%     9  53%    13  76%
>        6   43    27  63%    25  58%    22  51%    30  70%
>        7   54    34  63%    27  50%    27  50%    35  65%
>        8   47    31  66%    26  55%    21  45%    36  77%
>        9   31    19  61%    24  77%    20  65%    18  58%
>       10   21     5  24%     6  29%     9  43%     6  29%
>       11   22     9  41%    10  45%     7  32%     8  36%
>           402   219  54%   201  50%   175  44%   228  57%
>
>
>                  Bionic     Crafty
>                  v4.01      v 15.20
>                  K6/333     4x450
>                  48mb       96/20
>       Rd Total
>Bionic  1   60    40  67%    40  67%
>        2   38    24  63%    12  32%
>        3   30    28  93%    26  87%
>        4   40    37  93%    31  78%
>        5   17    14  82%    15  88%
>        6   44    38  86%    36  82%
>        7   53    38  72%    35  66%
>        8   47    33  70%    37  79%
>        9   32    27  84%    27  84%
>       10   22    17  77%    19  86%
>       11   22    17  77%    18  82%
>           405   313  77%   296  73%
>
>Opp.    1   60    32  53%
>        2   38    14  37%
>        3   30    20  67%
>        4   39    26  67%
>        5   17    10  59%
>        6   43    26  60%
>        7   54    29  54%
>        8   47    21  45%
>        9   31    21  68%
>       10   21    10  48%
>       11   22    10  45%
>           402   219  54%



This page took 0.01 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.