Computer Chess Club Archives


Search

Terms

Messages

Subject: Substantive way to judge program strength improvement?

Author: Shaun Graham

Date: 23:43:59 08/24/98


  Substantive way to judge program strength improvement other than ELO?  I ask
this question, because most programs coming out will only be 10-20 elo points
stronger than previous versions.  Since this is the case we could achieve a
similar gain in ELO by just creating a more highly optimized opening book.
Further since most new programs always claim to have an improved opening book,
how can we know there has been any real improvement?  I thought that perhaps you
could do the no opening book test, but i'm not certain that doing so shows much,
because  prog A might play the middle game and endgame great, but sucks in the
opening.  further it's not realistic in the sense, that all strong
players(humans) actually do have stored mental opening books.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.