Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Puzzled about testsuites

Author: Michel Langeveld

Date: 21:13:21 03/10/04

Go up one level in this thread


On March 09, 2004 at 14:24:16, Tord Romstad wrote:

>On March 09, 2004 at 12:02:47, Michel Langeveld wrote:
>
>>Hi Tord!
>
>Hi Michel!
>
>>Thanks for answering
>>
>>I am affraid you are right ... I test most of the time a lot and make tiny
>>steps. What timecontrol do you use for testing games?
>
>I am not a very patient person.  In most cases, I play 2 minutes/game
>or 4 minutes/game, with a 1 or 2 second increment.  Occasionally, I play
>at ridiculously fast time controls like 15 seconds/game.  The only point
>of playing these ultra-fast games is that I hope to eventually port my
>engine to slow hand-held devices.
>
>>>The complete ecm.epd would be no better.  All positions are tactical.
>>>LCT2 is great, but unfortunately I don't know any other suites of
>>>similar type and quality.
>>
>>What timecontrol do you normally use to test this? Do you look also for each
>>position to number of nodes searched. ply depth solution found?
>
>Are you asking specifically about LCT2 here, or about test suites in
>general?  LCT2 comes with instructions about how to run it.  You run
>each position for 10 minutes, and only solutions which is found and
>kept until the 10 minutes have passed are counted.

I ran the LCT2 tests here is the result:

Nullmover 0.25  : 2420 elo (this one is with kingsafety and mobility)
Nullmover 0.25c : 2445 elo (this one is without kingsafety and mobility)

So the C one must be stronger according this test result ... but it is more as
100 elo weaker. I think I will also check for a bug somewhere.

Michel

Nullmover 0.25c
POS01: d6   |0.20   = 30
POS02: Bb4  |0.00   = 30
POS03: Qc5  |X
POS04: e5   |84.33  = 20
POS05: Bb5  |X
POS06: e5   |45.55  = 20
POS07: Nd1  |X
POS08: Bh3  |X
POS09: Qd4  |7.52   = 30
POS10: Bf8  |X
POs11: h4   |100.94 = 15
POS12: Rb6  |X
POS13: Nxa2 |X
POS14: d5   |X
CBM01: Nxd6 |7.92   = 30
CBM02: Qxh7 |0.55   = 30
CBM03: Qf3  |6.52   = 30
CBM04: exf6 |4.96   = 30
CMB05: Rxh7 |3.52   = 30
CMB06: exf6 |3.47   = 30
CMB07: Rxc3 |3.39   = 30
CMB08: Nf6+ |24.36  = 25
CMB09: Rxd2 |37.08  = 20
CMB10: Bxh6 |105.39 = 15
CMB11: Nxh7 |X
CMB12: e5   |X
FIN01: f6   |1.58   = 30
FIN02: f5   |73.80  = 20
FIN03: Bxe4 |X
FIN04: h3   |72.45  = 20
FIN05: a6   |X
FIN06: f4   |3.81   = 30
FIN07: Bb4  |29.50  = 30
FIN08: c5   |X
FIN09: Kg4  |X

1900 + 520 = 2445

Nullmover 0.25c
POS01: d6   |0.20   = 30
POS02: Bb4  |0.00   = 30
POS03: Qc5  |X
POS04: e5   |84.33  = 20
POS05: Bb5  |X
POS06: e5   |45.55  = 20
POS07: Nd1  |X
POS08: Bh3  |X
POS09: Qd4  |7.52   = 30
POS10: Bf8  |X
POs11: h4   |100.94 = 15
POS12: Rb6  |X
POS13: Nxa2 |X
POS14: d5   |X
CBM01: Nxd6 |7.92   = 30
CBM02: Qxh7 |0.55   = 30
CBM03: Qf3  |6.52   = 30
CBM04: exf6 |4.96   = 30
CMB05: Rxh7 |3.52   = 30
CMB06: exf6 |3.47   = 30
CMB07: Rxc3 |3.39   = 30
CMB08: Nf6+ |24.36  = 25
CMB09: Rxd2 |37.08  = 20
CMB10: Bxh6 |105.39 = 15
CMB11: Nxh7 |X
CMB12: e5   |X
FIN01: f6   |1.58   = 30
FIN02: f5   |73.80  = 20
FIN03: Bxe4 |X
FIN04: h3   |72.45  = 20
FIN05: a6   |X
FIN06: f4   |3.81   = 30
FIN07: Bb4  |29.50  = 30
FIN08: c5   |X
FIN09: Kg4  |X

1900 + 520 = 2445




This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.