Computer Chess Club Archives


Search

Terms

Messages

Subject: Chess program similarity experiment

Author: Bruce Moreland

Date: 21:21:52 01/24/99


There has been some interest in the degree of difference between various
versions of Crafty and a Crafty derivative called Bionic Impakt.

Bionic Impakt played 11 games at the Dutch Championship last year.  This program
is supposedly significantly different from Crafty, but Bob claims that the
degree of similarity approached 100% in some games.

I would like to test this in reasonably scientific fashion, and I would be most
appreciative if the membership could help me.

I built EPD's for all positions in those 11 games, from move 20 onward.  There
are two EPD files for each game, one for Bionic Impakt's moves, and one for
moves made by the opponents.

I would like to enlist volunteers to run these tests and report results to me.
I will tabulate the results and report them in this thread.

I would like to see a variety of programs run each file run for one minute per
position.  There are 807 positions total, so this will take something under 14
hours to do, hopefully.  In order to score a "correct" answer, the program must
be planning to make the actual move at the end of the one-minute period.

I don't care what hardware people use, but I would like to know program,
version, CPU, and hash table size, please.

What I would like is to get a score for each program for each of the files.
I'll make a nice table and we can tell which program is most bionicesque.

I would like to specifically invite Bob to run this against the versions 9.26
and 15.20 of Crafty.  9.26 is the version used originally to build Bionic
Impakt, and 15.20 is the version they took the parallel search from.

    http://www.impakt.be/bionic/about.htm

I would like see results in the form:

rd01o.epd: 45
rd01b.epd: 39
rd02o.epd: 52
rd02b.epd: 57
...

If someone can't do this, I'll take whatever you can do, but I would really
rather not wade through megabytes of stuff.

If you can't run all 22 files, please run "rd01o.epd", "rd01b.epd", "rd08o.epd",
and "rd08b.epd", if you could.

Files of EPD's will be appended to this in the form of responses.  You can copy
the EPD files out of there, there are five or six per response.  If you would
like these EPD's in some other form, please email me, there is a good chance
that I can auto-generate them.  I will also post the 11 games in PGN form, which
I took from the Bionic Impakt web page:

http://www.impakt.be/bionic/

My email address is brucemo@seanet.com

Thank you,

bruce



This page took 0.02 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.