Author: Robert Hyatt
Date: 19:52:13 06/27/98
Go up one level in this thread
On June 27, 1998 at 19:28:01, Mark Young wrote: > >Are their any test suites that can give you an idea of how strong a program >really is? The more I run test suites today, the more I am convinced that they >are meaningless in gauging a program s strength no. several have tried, but running a suite, then fitting a bizarre function to known ratings of programs that can be used to produce results for that suite. But this doesn't mean a thing to *other* programs that are different from the ones used to create the formula. Ask Don about Larry's formula from an old suite of his that he thought was pretty good, *until* we ran the suite on Cray Blitz at Indianapolis ACM (I think). It blew out the formula badly... and gave results that were just about meaningless. because it solved almost everything in 0 seconds per position... much better to do as you (and I and Bruce and others) do and play them on a server against known humans and programs. That gives a much better feel than a series of chess positions.
This page took 0.01 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.