Author: Manfred Rosenboom
Date: 07:51:38 08/16/98
Go up one level in this thread
On August 16, 1998 at 06:37:33, mike cooter wrote:
>What are the directions for runnning the suite itself? I mean how many minutes
>per problem and how to score etc.?
You will find the following in the Rebel 9 FAQ at
http://www.rebel.nl/faq.htm
==================================================================
3.5. Using the BT2450, BT2630 and BS2830 Rebel Databases
Part of the Rebel 9.0 release are the Rebel databases BT2450 and BT2630.
This databases contain the positions of the BT2450 and BT2630 test suites.
This test suites are designed by Hubert Bednorz and Fred Toennissen for
measuring the tactical capabilities of chess engines. BT2630 is the
predecessor of BT2450.
Each test suite contain 30 positions. Select each position and let Rebel
think for 15 minutes (900 seconds). If a position is solved, write down
its solution time in seconds. It doesn't count as a solution if Rebel
finds, the move and then changes its mind. If after finding a move,
then changing its mind, then finding it again, you should use the last
time found. Any solution that is not found, score as 900 seconds. Add up
all the times, divide by 30 and subtract the result from either 2630 or
2450. The final figure is Rebel's (BT-) ELO rating.
The new BS2830 (Bednorz-Schumacher) test suite can be downloaded from
the Rebel 9 subscription aera. This suite is designed for programs,
with an expected SSDF-ELO rating of 2300 or higher. The test suite
contain 27 positions. Select each position and let Rebel think for
15 minutes. If a position is solved, write down its solution time in
minutes. It doesn't count as a solution if Rebel finds, the move and
then changes its mind. If after finding a move, then changing its mind,
then finding it again, you should use the last time found. Any solution
that is not found, score as 15 minutes. Add up all the times (in minutes)
to the total time TT (in minutes). You get the (BS-) ELO rating with the
following formula (updated in CSS 2/1998):
BS2830-ELO = 2830 - TT/1.5 - (TT * TT)/(22 * 22)
Be aware, that the authors changed the formular in April 1998. The older
formular (CSS 4/97) was
BS2830-ELO = 2830 - (TT * TT)/(17 * 17)
So all older results must be recalculated.
Be cautious in interpreting the BT/BS results. The BT/BS values are
only indicators for the tactical strenght of a chess engine. You can't
measure the positional strength of a chess engine with this test suites.
==================================================================
Manfred
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.