Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: SSDF Rating List 01-10-02

Author: Uri Blass

Date: 03:52:54 10/03/01

Go up one level in this thread


On October 03, 2001 at 06:23:09, Thoralf Karlsson wrote:

>      THE SSDF RATING LIST 2001-10-02   81185 games played by  226 computers
>                                           Rating   +     -  Games   Won  Oppo
>                                           ------  ---   --- -----   ---  ----
>   1 Deep Fritz 256MB Athlon 1200 MHz        2726   55   -51   182   65%  2618
>   2 Gambit Tiger 2.0  256MB Athlon 1200     2720   50   -48   205   59%  2653
>   3 Chess Tiger 14.0 CB 256MB Athlon 1200   2703   49   -46   230   65%  2592
>   4 Shredder 5.32  256MB Athlon 1200        2699   50   -47   222   67%  2577
>   5 Junior 7.0  256MB  Athlon 1200          2679   61   -59   140   59%  2615
>   6 Deep Fritz  128MB K6-2 450 MHz          2654   27   -26   731   63%  2560
>   7 Gandalf 4.32h  256MB Athlon 1200 MHz    2653   68   -63   119   61%  2574
>   8 Gambit Tiger 2.0  128MB K6-2 450 MHz    2640   30   -29   592   66%  2521
>   9 Chess Tiger 14.0 CB 128MB K6-2 450 MHz  2632   32   -30   537   66%  2518
>  10 Junior 7.0  128MB K6-2 450 MHz          2624   45   -42   271   65%  2518
>  11 Fritz 6.0  128MB K6-2 450 MHz           2623   23   -23   968   64%  2521
>  12 Shredder 5.0  128MB  K6-2 450 MHz       2601   24   -23   928   63%  2509
>  13 Shredder 5.32  128MB K6-2 450 MHz       2600   36   -34   409   61%  2517
>  14 Junior 6.0  128MB K6-2 450 MHz          2596   20   -19  1305   61%  2514
>  15 Chess Tiger 12.0 DOS 128MB K6-2 450 MHz 2582   24   -24   857   58%  2525
>  16 Shredder 4.0  128MB  K6-2 450 MHz       2566   23   -23   944   59%  2505
>  17 Fritz 5.32  128MB K6-2 450 MHz          2552   25   -25   804   58%  2497
>  18 Nimzo 7.32  128MB K6-2 450 MHz          2551   23   -23   937   57%  2498
>  19 Nimzo 8.0  128MB K6-2 450 MHz           2549   26   -26   715   54%  2521
>  20 Junior 5.0  128MB K6-2 450 MHz          2536   24   -24   835   56%  2491
>  21 Gandalf 4.32f  128MB K6-2 450 MHz       2532   28   -28   627   51%  2525
>  22 Hiarcs 7.32  128MB K6-2 450 MHz         2522   25   -24   809   52%  2506
>  22 Hiarcs 7.01  128MB K6-2 450 MHz         2522   34   -34   419   46%  2550
>  24 SOS  128MB  K6-2 450 MHz                2519   21   -21  1130   50%  2519
>  24 Rebel Century 3.0  128MB K6-2 450 MHz   2519   30   -30   546   49%  2525
>  26 Chessmaster 8000  128MB K6-2 450 MHz    2516   44   -45   251   45%  2549
>  27 Gandalf 4.32h  128MB K6-2 450 MHz       2511   41   -41   286   52%  2496
>  28 Goliath Light  128MB K6-2 450 MHz       2502   27   -27   668   44%  2545
>  29 Nimzo 99  128MB K6-2 450 MHz            2490   24   -24   867   48%  2504
>  30 Crafty 17.07/CB 128MB K6-2 450 MHz      2488   24   -24   857   47%  2506
>  31 Fritz 5.32  64MB P200 MMX               2478   17   -17  1679   50%  2476
>  32 Genius 6.5  128MB  K6-2 450 MHz         2475   29   -29   565   48%  2488
>  33 Chessmaster 6000  64MB P200 MMX         2474   61   -53   184   76%  2278
>  33 MChess Pro 8.0  128MB K6-2 450 MHz      2474   28   -28   629   42%  2532
>  35 Hiarcs 7.32  64MB P200 MMX              2469   22   -22  1042   53%  2448
>  36 Nimzo 99  64MB P200 MMX                 2447   23   -23   885   51%  2440
>  37 Junior 5.0  64MB P200 MMX               2432   18   -19  1429   45%  2469
>  38 Rebel 9.0  47MB P200 MMX                2421   24   -23   900   61%  2342
>  39 Shredder 3.0  64MB P200 MMX             2417   20   -20  1190   49%  2424
>  40 Zarkov 5.0  64MB P200 MMX               2409   25   -26   749   42%  2469
>  41 Shredder 2.0  58MB P200 MMX             2402   19   -19  1314   44%  2441
>  42 Genius 5.0 DOS  46MB P200 MMX           2391   20   -20  1197   49%  2395
>  42 MChess Pro 8.0  64MB P200 MMX           2391   27   -27   681   53%  2367
>  44 Gandalf 3.0  64MB P200 MMX              2365   41   -40   307   59%  2297
>  45 WChess2000  64MB P200 MMX               2355   31   -32   522   36%  2457
>  46 R30 v. 2.5                              2274   41   -38   343   69%  2135
>  47 Meph Genius 68 030 33 MHz               2198   45   -44   248   55%  2161
>  48 Berlin Pro 68 020 24 MHz                2125   24   -24   850   58%  2071
>  49 Atlanta    SH7000 20 MHz                2090   29   -28   647   69%  1949
>  50 Sapphire II                             2012   35   -33   444   63%  1916
>
>
> 1 Deep Fritz 256MB Athlon 1200 MHz, 2726
>GT2.0 A1200     21.5-18.5  CT14.0 A1200      20-20    Junior6 K6450     30-12
>Nimzo 8 K6450   29.5-10.5  Nimzo98 P200X     17-3
>
> 2 Gambit Tiger 2.0  256MB Athlon 1200, 2720
>DpFritz A1200   18.5-21.5  CT14.0 A1200      21-19    Shre532 A1200   20.5-19.5
>Junior7 A1200   24.5-16.5  Fritz532 P200     37-7
>
> 3 Chess Tiger 14.0 CB 256MB Athlon 1200, 2703
>DpFritz A1200     20-20    GT2.0 A1200       19-21    Nimzo 8 K6450   32.5-15.5
>Hiar732 K6450   37.5-12.5  SOS  K6-2 450     30-10    Nimzo98 P200X     11-1
>
> 4 Shredder 5.32  256MB Athlon 1200, 2699
>GT2.0 A1200     19.5-20.5  CT14 CB K6450   27.5-12.5  Ch.Ti12 K6450   23.5-18.5
>Junior5 K6450   28.5-11.5  Nimzo99 K6450     32-8     Nimzo98 P200X     17-3
>
> 5 Junior 7.0  256MB  Athlon 1200, 2679
>GT2.0 A1200     16.5-24.5  Gan432h A1200     21-11    Ch.Ti12 K6450     25-17
>Junior5 K6450      3-2     Nimzo98 P200X     17-3
>
> 7 Gandalf 4.32h  256MB Athlon 1200 MHz, 2653
>Junior7 A1200     11-21    Shre532 K6450      5-2     Ch.Ti12 K6450     24-16
>Fritz532 P200   32.5-7.5
>
> 10 Junior 7.0  128MB K6-2 450 MHz, 2624
>DpFritz K6450   21.5-20.5  GambTig K6450     19-21    Goliath K6450   23.5-16.5
>Fritz532 P200   28.5-13.5  MCP8 K6-2 450   30.5-9.5   Junior5 P200X   17.5-7.5
>Shre3 P200MMX   34.5-7.5
>
> 13 Shredder 5.32  128MB K6-2 450 MHz, 2600
>DpFritz K6450   15.5-26.5  Gan432h A1200      2-5     GambTig K6450     17-23
>Junior6 K6450   25.5-30.5  Nimzo 8 K6450   17.5-17.5  Nimzo99 K6450      1-0
>Fritz532 P200     26-14    Hiar732 P200X   31.5-12.5  Junior5 P200X     34-8
>Nimzo98 P200X   31.5-8.5   Shre3 P200MMX     33-9     Shred 2 P200X     17-3
>
> 27 Gandalf 4.32h  128MB K6-2 450 MHz, 2511
>GambTig K6450     12-28    Nimzo 8 K6450     17-25    SOS  K6-2 450   20.5-19.5
>Fritz532 P200   20.5-19.5  MCP8 K6-2 450     14-9     Junior5 P200X   22.5-16.5
>Shre3 P200MMX   28.5-13.5  Shred 2 P200X     14-6
>
>
>
>Until 1998 the SSDF rating list came out rather
>regularly, about every 6-7 weeks. During the recent
>years the time interval has increased to ten weeks
>in average. The present list now appears more than
>16 weeks after the former one... Where will this end?
>
>Although it might seem so, we have no intention to
>cancel the publication of the SSDF rating list! The
>reason for the present delay is our ongoing shift of
>hardware. We wanted to include six of the strongest
>programs on the faster hardware on the first occasion.
>And this takes time, especially since our capacity is
>split between faster and slower hardware.
>
>Since June 11, we have played 2143 new tournament games.
>What conclusions can be drawn from these games? The strength
>of the new programs doesn't differ much from their pre-
>decessors, unfortunately. But new hardware continues to
>give significant increases in their SSDF ratings! It
>could be that some programs earn clearly more than others
>on faster hardware. And Deep Fritz is still on the top of
>the list!
>
>Let's first look at the new programs on K6-2 450. Junior 7.0
>K6-2 450 MHz has a rating of 2624 after 271 games, which is
>28 points more than Junior 6.0 has. More games will show if
>this is a significant increase or not. We have played 409
>games with Shredder 5.32 K6-2, and it's present rating is
>2600. As can be seen it has practically speaking the same
>rating as Shredder 5.0, only one point differs. The result
>for Gandalf 4.32h K6-2 450 MHz is 21 points less than what
>the predecessor 4.32f has.
>
>Among the older programs on K6-2 450 MHz, there are some
>changes worth mentioning. Chessmaster 8000 has received
>14 more points, Gambit Tiger 2.0 has gone down 10 points
>and Nimzo 8.0 K6-2 is seven points up.
>
>Athlon 1200 MHz with 256MB RAM is the new hardware level
>on the SSDF rating list. The average rating increase is
>so far 84 points! Junior 7.0 has earned the least, with only
>55 points. Shredder 5.32 is 99 points up and Gandalf 4.32h
>has 142 points more!! OK, we have only played 119 games
>with Steen Suurballes program, so much could change with
>more games. But since the speed gain for Gandalf 4.32h is
>larger than for other programs, it might well be that the
>trend is true.
>
>The main difference between Athlon 1200 and K6-2 450 comes
>from the above mentioned. On Athlon Shredder 5.32 is higher
>placed than Junior 7.0, and Gandalf 4.32h is much closer to
>the top of the list. Deep Fritz is leading on both lists,
>closely followed by the two Tiger-versions.
>
>Next list will probably appear in November. Hopefully
>Fritz 7.0 will be included on that list.
>
>Thoralf Karlsson

The list support mark young's claim that Gambittiger earns more from fast
hardware relative to tiger14(80>71) but unfortunately there are not enough games
to see significant difference when there is a possible error of 50 elo in the
rating if we want 95% confidence.

We probably need 20,000 games of both programs in order to get possible error in
rating of 5 elo and if we continue to get similiar difference of 9 elo in the
improevement between Gambit2 and Tiger14 then it may be a convincing evidence
that Mark young is right.

Here is the improvement in rating.
It may be interesting to see also a list of the improvement in speed because I
know that the 142 for gandalf is explained(at least part of it) by bigger speed
improvement from the A1200

1)Gandalf4.32h 2653-2511=142
2)Shredder5.32 2699-2600=99
3)Gambittiger 2720-2640=80
4)Deep Fritz 2726-2654=72
5)Tiger14 2703-2632=71
6)Junior7 2679-2624=55

Uri



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.