Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: SAN problem with Crafty's wall.pgn book

Author: Robert Hyatt

Date: 07:25:37 06/16/98

Go up one level in this thread


On June 16, 1998 at 10:17:24, Peter Herttrich wrote:

>On June 15, 1998 at 09:48:16, Robert Hyatt wrote:
>
>>On June 15, 1998 at 03:46:44, Peter Herttrich wrote:
>>
>>>On June 15, 1998 at 01:47:52, Steven J. Edwards wrote:
>>>
>>>>Fellow Programmers:
>>>>
>>>>In working with Crafty's opening book PGN file wall.pgn, I noticed an
>>>>error in SAN in one of the games.  (There may be more than one; this is
>>>>the first.)  It shows up at line 3,864,317 in column 47; it is a pawn
>>>>capture "exf1" but has no promotion indication.
>>>>
>>>>Have other PGN readers choked on this?  If not, then they should have.
>>>>It is incorrect to assume a promotion to a queen.
>>>>
>>>>Anyway, having nearly four million lines of good PGN before the first
>>>>problem is still pretty good.
>>>>
>>>>-- Steven (sje@mv.mv.
>>>
>>>Thanks, costs me some hours, to clean and throw out the doubles.
>>>If i have more time I will go for this problem, but for CRAFTY
>>>it's no problem to build the book.
>>>
>>>The newwall.pgn will be out in some weeks. It's more then
>>>twice the wall.pgn.
>>>
>>>Cheerio
>>>Peter
>>
>>
>>I suppose that if you are going to continue this insane behavior, I'm
>>going to have to design a new way to build the book.  Doubling the file
>>will mean someone needs way over 2 gigs free at present.  That is just
>>about unmanagable.
>>
>>:)
>
>uummmmmmmmpffff....
>
>y're right. my last experiments nearly filled my new 2Gig HD.
>and the source was down in my local-dir.
>damned, someone there who spend me a 9Gig HD ? :-)
>
>But anyway, do you see a chance to build books without this
>amount of hd-room?
>Because i plan after the newwall.pgn (projectname rock:) )
>the 1Gig pgn, (projectname mountain).
>
>no no no, don't kill me.
>Just kidding. But the rock will come.
>
>
>Cheerio
>Peter


It can be reduced.  Currently a book position is 20 bytes...  8 for the
hash signature, plus the win/lose/draw counts (2 each) plus 2 bytes for
the flags (?, !) plus 4 for the learned score.  I am going to cut the
flags in 1/2 anyway as no one uses them all, and until the final merge
phase, I can carry 10 bytes around rather than 20, which will cut the
temp storage by 50%.

this will happen before long...  but it will take your double-size book
and reduce it back down to 1.2 gigs of temp space or so, which is still
big.  And it won't compress much either as it is mostly random bits.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.