Computer Chess Club Archives


Search

Terms

Messages

Subject: How to compare with Deep Blue '97 (methodically)?

Author: Mike S.

Date: 17:30:16 08/02/01


There may be a chance to get a *rough estimation*, if a computer chess system is
at (or even above) Deep Blue '97 level: If somebody would be capable to distil
at least 10 good test positions from the 1997 match games. I can imagine that
this could be done, supported by the Deep Blue logs which are downloadable
somewhere on the net I think (I'm sure the URL is easy to find). I've heard they
are somewhat difficult to read though (?).

Preferably, we should search for "single move" situations, i.e. when D.B.
recognised a subtle threat of Kasparov and found the clearly best defensive move
early, or played such a threat itself, etc. We would need to find positions,
which can suit as - very diffcult - test positions. The log data (hopefully)
shows the time D.B. needed to find those moves each. I don't expect that more
than 10 suitable positions can be found (if at all), which is a small number -
but still much better than comparing node rates or whatever.

Then, today's chess computer systems could be tested with that, and we would
have at least some hard facts comparison instead of speculations. If a program
can find let's say 8 or 9 out of 10 after similar, sometimes better time, I'd
consider it is Deep Blue level. So we could compare performance... and you know
it, only the performance counts! :o)

Please give your opinions if this idea makes sense, which I want to read before
I start searching those logs, analyzing, testing, etc. (hopefully the idea is
nonsense and I can save the effort :o).

Regards,
Michael Scheidl



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.