Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: benchmark test for fun (and for Vincent)

Author: Matthew Hull

Date: 22:23:58 09/04/02

Go up one level in this thread


On September 04, 2002 at 23:49:08, Sean Mintz wrote:

>Hi all,
>
>I've been playing with this position since it was posted here tonight. Seems
>like it would have been pretty straightforward and I should have posted by now,
>but I am having some problems.
>
>I am running three executables on my machine (dual 1.2 ghz athlon mp's, 512 mb
>ram). One I made, Aaron and Slaters, and the original (all 18.15, smp).
>
>None are reporting depth 13 results except for the original exe running with
>''mt 2''.
>
>They were all running with my normal crafty.rc which has always seemed to work,
>but I thought it still might have been that. So I put all of the executables in
>their own empty directory and ran them using the following commands (not in any
>.rc file):
>
>hash 48m
>hashp 24m
>easy
>sd 13
>2r2rk1/1bqnbpp1/1p1ppn1p/pP6/N1P1P3/P2B1N1P/1B2QPP1/R2R2K1 b - - 0 1
>
>Heres the output from Aaron and Slaters exe, from its own empty directory:
>
>=========================
>
>EPD Kit revision date: 1996.04.21
>unable to open book file [./book.bin].
>book is disabled
>unable to open book file [./books.bin].
>
>Crafty v18.15 (1 cpus)
>
>White(1): hash 48m
>hash table memory = 48M bytes.
>White(1): hashp 24m
>pawn hash table memory = 24M bytes.
>White(1): easy
>pondering disabled.
>White(1): sd 13
>search depth set to 13.
>White(1): 2r2rk1/1bqnbpp1/1p1ppn1p/pP6/N1P1P3/P2B1N1P/1B2QPP1/R2R2K1 b - - 0 1
>Black(1): go
>              clearing hash tables
>              time surplus   0.00  time limit 30.00 (3:30)
>         nss  depth   time  score   variation (1)
>                6     0.28     ++   1. ... Bxe4!!
>                6     0.31  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7
>         (3)    6->   0.33  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7
>         (2)    7     0.41  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7
>                7->   0.45  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7
>                8     0.61  -0.55   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rc5
>                8->   0.75  -0.55   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rc5
>                9     1.39  -0.70   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7 6. Bc3 a4
>                9->   1.50  -0.70   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7 6. Bc3 a4
>               10     2.30  -0.44   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rc7 6. Bd4 Nfd7
>               10->   2.94  -0.44   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rc7 6. Bd4 Nfd7
>               11     5.92  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7 6. Bd4 Re2
>                                    7. b6 Rd8
>               11->   6.85  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7 6. Bd4 Re2
>                                    7. b6 Rd8
>               12    12.49  -0.48   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rcc8 6. Bd4 Nfd5
>                                    7. Rac1 Rfd8 8. Rxc8 Rxc8
>              time=32.33  cpu=99%  mat=0  n=21117091  fh=92%  nps=653k
>              ext-> chk=186141 cap=65899 pp=8220 1rep=10731 mate=267
>              predicted=0  nodes=21117091  evals=5545891
>              endgame tablebase-> probes done=0  successful=0
>              hashing-> trans/ref=33%  pawn=99%  used=71%
>              SMP->  split=0  stop=0  data=0/32  cpu=32.12  elap=32.33
>
>Black(1): Bxe4
>              time used:  32.33
>learning position, wtm=0  value=48
>White(2): quit
>execution complete.
>
>=========================
>
>Here is output from the original exe, 1 cpu:
>
>EPD Kit revision date: 1996.04.21
>unable to open book file [./book.bin].
>book is disabled
>unable to open book file [./books.bin].
>
>Crafty v18.15 (1 cpus)
>
>White(1): hash 48m
>hash table memory = 48M bytes.
>White(1): hashp 24m
>pawn hash table memory = 24M bytes.
>White(1): easy
>pondering disabled.
>White(1): sd 13
>search depth set to 13.
>White(1): 2r2rk1/1bqnbpp1/1p1ppn1p/pP6/N1P1P3/P2B1N1P/1B2QPP1/R2R2K1 b - - 0 1
>Black(1): go
>              clearing hash tables
>              time surplus   0.00  time limit 30.00 (3:30)
>         nss  depth   time  score   variation (1)
>                6     0.41   0.19   1. ... Nh7 2. Qe3 Bf6 3. Qf4 Bxb2 4.
>                                    Nxb2 Nhf6
>                6     0.48     ++   1. ... Bxe4!!
>                6     0.53  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7
>         (4)    6->   0.55  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7
>         (3)    7     0.64  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7
>                7->   0.67  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7
>                8     0.86  -0.55   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rc5
>                8->   1.02  -0.55   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rc5
>                9     1.73  -0.70   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7 6. Bc3 a4
>                9->   1.87  -0.70   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7 6. Bc3 a4
>               10     2.77  -0.44   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rc7 6. Bd4 Nfd7
>               10->   3.50  -0.44   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rc7 6. Bd4 Nfd7
>               11     6.83  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7 6. Bd4 Re2
>                                    7. b6 Rd8
>               11->   7.89  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7 6. Bd4 Re2
>                                    7. b6 Rd8
>               12    14.17  -0.48   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rcc8 6. Bd4 Nfd7
>                                    7. Rac1 Rfd8 8. Rxc8 Rxc8
>         (2)   12->  24.08  -0.48   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rcc8 6. Bd4 Nfd7
>                                    7. Rac1 Rfd8 8. Rxc8 Rxc8
>              time=30.37  cpu=98%  mat=0  n=18807268  fh=93%  nps=619k
>              ext-> chk=165138 cap=57957 pp=3855 1rep=6309 mate=199
>              predicted=0  nodes=18807268  evals=4393363
>              endgame tablebase-> probes done=0  successful=0
>              SMP->  split=0  stop=0  data=0/32  cpu=29.91  elap=30.37
>
>Black(1): Bxe4
>              time used:  30.37
>learning position, wtm=0  value=48
>White(2): quit
>execution complete.
>
>=========================
>
>And finally, here is output from the original exe, 2 cpus:
>
>EPD Kit revision date: 1996.04.21
>unable to open book file [./book.bin].
>book is disabled
>unable to open book file [./books.bin].
>
>Crafty v18.15 (1 cpus)
>
>White(1): hash 48m
>hash table memory = 48M bytes.
>White(1): hashp 24m
>pawn hash table memory = 24M bytes.
>White(1): easy
>pondering disabled.
>White(1): sd 13
>search depth set to 13.
>White(1): mt 2
>max threads set to 2
>White(1): 2r2rk1/1bqnbpp1/1p1ppn1p/pP6/N1P1P3/P2B1N1P/1B2QPP1/R2R2K1 b - - 0 1
>Black(1): go
>              clearing hash tables
>              time surplus   0.00  time limit 30.00 (3:30)
>         nss  depth   time  score   variation (1)
>starting thread 1
>                6     0.37     ++   1. ... Bxe4!!
>                6     0.41  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7
>         (4)    6->   0.41  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7
>         (3)    7     0.45  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7
>                7->   0.48  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7
>                8     0.61  -0.55   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rc5
>                8->   0.69  -0.55   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rc5
>                9     1.14  -0.70   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7 6. Bc3 a4
>                9->   1.22  -0.70   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7 6. Bc3 a4
>               10     1.78  -0.44   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rc7 6. Bd4 Nfd7
>               10->   2.22  -0.44   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rc7 6. Bd4 Nfd7
>               11     4.23  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7 6. Bd4 Re2
>                                    7. b6 Rd8
>               11->   4.87  -0.69   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7 6. Bd4 Re2
>                                    7. b6 Rd8
>               12     8.69  -0.48   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rcc8 6. Bd4 Nfd5
>                                    7. Rac1 Rfd8 8. Rxc8 Rxc8
>         (2)   12->  15.39  -0.48   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Nxb6 5. Bd3 Rcc8 6. Bd4 Nfd5
>                                    7. Rac1 Rfd8 8. Rxc8 Rxc8
>               13    26.00  -0.63   1. ... Bxe4 2. Bxe4 Qxc4 3. Qxc4 Rxc4
>                                    4. Nxb6 Rxe4 5. Nxd7 Nxd7 6. Bd4 Rb8
>                                    7. Rac1 Rxb5 8. Rc7 e5 9. Rxd7 exd4
>                                    10. Nxd4
>              time=30.36  cpu=393%  mat=0  n=30628797  fh=93%  nps=1008k
>              ext-> chk=261557 cap=92916 pp=5624 1rep=11664 mate=417
>              predicted=0  nodes=30628797  evals=7292289
>              endgame tablebase-> probes done=0  successful=0
>              SMP->  split=298  stop=24  data=6/32  cpu=1:59  elap=30.36
>
>Black(1): Bxe4
>              time used:  30.36
>learning position, wtm=0  value=63
>White(2): quit
>execution complete.
>
>=========================
>
>I have one of the slower dual athlons which returns some better speedups
>(compared to the faster dual athlons), so hopefully we can figure this out.

Looks like your tanking after 30 seconds each time.  The time parameter is
overriding the search depth parameter maybe.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.