Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Crafty WAC Results

Author: Bruce Moreland

Date: 16:13:13 09/12/01

Go up one level in this thread


On September 12, 2001 at 18:38:07, Slater Wold wrote:

>I tested Crafty against the 300 WAC positions, yesterday and today.
>
>The tests were run with 48M of hash, and 10M of hashp.  Also all 5 piece TB were
>in place, and the machine was a 2x1.4Ghz that gets roughly 1.41M nps on the
>bench test.  (That's with the hash.  With nothing but smpmt 2, it gets 1.44M.)
>
>1 second = 275/300 (Interestly, Deep Shredder get 274/300 in this test.)
>
>3 seconds = 293/300
>
>5 seconds = 294/300
>
>10 seconds = 295/300
>
>60 seconds = 296/300

WAC is a dumb test when you have a program at this level.  You can throw out all
but about 10 of them, and you still have something that's hard to use to test a
program at a sensible time control, because the remainder are either too easy
(still) or too hard.

bruce

>
>Results from the 60 second test:
>
>total: 300
>total acd: 3675   mean total acd: 12.25
>total acn: -673005227   mean total acn: -2243350.76
>total acs: 13671   mean total acs: 45.57
>total mean node frequency: -49228.68 Hz
>solve: 296   solve percent: 98.67
>solve acd: 3612   mean solve acd: 12.20
>solve acn: -1017101576   mean solve acn: -3436153.97
>solve acs: 13430   mean solve acs: 45.37
>solve mean node frequency: -75733.55 Hz
>unsol: 4   unsol percent: 1.33
>unsol acd: 63   mean unsol acd: 15.75
>unsol acn: 344096349   mean unsol acn: 86024087.25
>unsol acs: 241   mean unsol acs: 60.25
>unsol mean node frequency: 1427785.68 Hz
>
>Bob had stated he had an Alpha 750mhz machine that got all 300 in 60 seconds.
>Surely I am killing that machine in nps, and don't fully understand this.
>
>I also have the logs, if anyone is interested.
>
>
>Slate



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.