Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Binary Book Creation

Author: Gian-Carlo Pascutto

Date: 08:16:24 06/19/00

Go up one level in this thread


On June 19, 2000 at 08:15:58, Adrien Regimbald wrote:

>Probably you pay some overhead for the ease-of-access .. and probably also it >is not perfect at allocating how much space it needs to hold everything (ie. >there are probably some empty hashing cells that still get stored into your >final output book).  I really wouldn't know though, I'm not familiar with >GDBM .. but from past experience with other hashing tools to make your life >simpler, they usually aren't efficient .. but they DO save you a substantial >headache! :P

There is a 'reorganize' call that I use at the end of the book generation.
I should probably take a good look at how GDBM works though ;)

>>My main problem right now is speed...it takes redicolously long to parse in
>>all PGN (darn my parser is slow) and GDB slows down due to disk accesses when
>>the database gets big (still smaller than physical RAM though...so I dont
>>get why it does).
>How long?  My book creation took about 5 seconds for those ~13,000 games (a 7 >MB PGN file) on a P233 w/ 64 MB RAM.

Don't laugh.

The initial speed is about 7 games per second. When disk access gets heavy
it slows down to about 2 games per second.

I put it on a 55000 game database and left it running for the night.
When I got up, it was still going...

(Celeron 366, 64MB, Windows 98)

The main reason for this is that I call my movegenerator inside
the move conversion. I'd expect it to be about 25 to 300 times
faster when I fix this ;)

>Hmm, that'd be cool :)  Would it be possible for me to get my own sourceforge
>workspace (or whatever you want to call it) ??

Sure, take a look at www.sourceforge.net. They offer all kinds of very
interesting stuff for free, on the condition that your program is opensourced.

--
GCP



This page took 0.01 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.