Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: LG2000a vrs Crafty

Author: Bernhard Bauer

Date: 02:45:55 10/05/99

Go up one level in this thread


On October 04, 1999 at 10:34:55, Robert Hyatt wrote:

>On October 04, 1999 at 10:14:16, Bernhard Bauer wrote:
>
>>
>>>>
>>>>Game 17 looks odd:
>>>>1. d4
>>>>{White mates} 1-0
>>>>
>>>>
>>>>So my impression is that Crafty is stronger than LG2000a.
>>>>Kind regards
>>>>Bernhard
>>>
>>>
>>>There are some subtle places where timing can screw up.  IE take this:
>>>
>>>white wins (crafty) and the first thing it does is to go adjust the learning
>>>stuff (maybe) after playing the move that leads to mate.  Then black realizes
>>>that he is mated and tells xboard, which promptly declares the game a win for
>>>white and tells both to start a 'new' game.  Meanwhile, white has finished the
>>>learning cycle, and now tells xboard that it won.  IE in _any_ winboard/xboard
>>>tournament, you need to examine the pgn file for each game to be sure that the
>>>result given was correct.  This is a problem that is not easy to fix.  It might
>>>be better to use the -xreuse option so that both programs get restarted after
>>>each game, which means the communication pipes get reset (hopefully) before each
>>>game to prevent this timing glitch.
>>>
>>>Else it would be better if xboard declared the wins/losses/draws and totally
>>>ignore a program's claim, to avoid this...
>>
>>Good to know, so I will use -xreuse for future matches. BTW, on a decent system
>>(linux, winnt, ...) ponder=on should be the better way to run such a tournament.
>>
>>Kind regards
>>Bernhard
>
>
>Note that I haven't studied this carefully...  the -xreuse option might still
>suffer from timing oddities for all I know.  But it seems that it should be a
>bit safer.  Try playing a 100 game match, game in 1 minute, then check the
>pgn file xboard produces to be sure there are no 1 move games...  if it works,
>or fails, report back so we will know whether the raw results can be trusted
>or if the pgn needs inspection for all such matches...
>
>this will raise interesting questions about all winboard/xboard matches, and I
>wonder how the chessbase winboard interface handles this?

Ok, I ran that tournament. Here are the results.

Third match against LG2ka
Time: Game in 1 min
       winboard -mg 100 -xreuse  -fcp "wcrafty hash=24M hashp=4M cache=2M egtb"
                                 -scp "goliath\LG2000a.exe"
                -tc 1 -inc 0     -sgf matchfile.pgn

Legend:
         0   Crafty lost the game
         1   Crafty won  the game
         d   draw
         N   game doesn't exist, not in game file
         X   Crafty mates in 1 move

Result:
  games 1-50
         12345678901234567890123456789012345678901234567890
Crafty   d0X0X0X1d0X0X1110Nd10N10X0X0Xd10Xd0N11d0X0X0X0X0X0

So Crafty had 18 losses
               9 wins
               6 draws
              14 mates in 1
               3 games doesn't exist

  games 51-100
         12345678901234567890123456789012345678901234567890
Crafty   Xd10X1110N0N0N1110X0Xdd10N11d1d10N0N0N10X0X0X0X1d1


So Crafty had 14 losses
              15 wins
               6 draws
               8 mates in 1
               7 games doesn't exist

together:
   Crafty had 32 losses
              24 wins
              12 draws
              22 mates in 1
              10 games don't exist

Looks like the results have to be treated with care.
Only crafty wins in one move and only when crafty has the white pieces (22
times).
The game is only missing when lg2ka has the white pieces (10 times).
Oh, I forgot, the match was run under WinNT 4.0

Kind regards
Bernhard



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.