Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Engine v engine tests not reliable

Author: Dann Corbit

Date: 10:02:48 06/15/99

Go up one level in this thread


On June 15, 1999 at 12:31:28, eric guttenberg wrote:

>Today I read a post here by Jim Walker in which he reports 80 games at g/5min
>between Fritz 5.32 and Hiarcs 7.32 with virtually equal results.  Significantly
>this was not engine v engine, and suggests that all these engine v engine
>results where H7.32 wins about 80% of the points are not valid. Again and
>again there are posts suggesting that the engine v engine results are not
>reliable and again and again these cautions are flung down and danced upon
>by repeated postings claiming a huge superiority by H7.32 over F5.32 based on
>yet another engine v engine match.

But when we use the native interface, it is nothing but a shiny cover over the
engine.  If the engine is superior, then how is changing the interface going to
alter anything?  If it does then there is some kind of bug, or the human running
the programs and entering the moves manually is doing something wrong.

>The non-engine v engine results I have seen suggest that Hiarcs' superiority
>over Fritz is significant but not overwhelming and in the case of g/5 min
>blitz games, F5.32 may be as good or better.
A carefully controlled scientific experiment can confirm or deny the hypothesis.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.