Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: CDB and large pgn files

Author: Danniel Corbit

Date: 00:04:14 09/01/98

Go up one level in this thread


1.  First create a tiny file and save it.
2.  Import as large a file as you like.
3.  If you want to import wall, you can do it, but you should have 1GB ram if
you want it to be fast.  I have found that it takes about 1.2 times the size of
the raw PGN file to hold the CDB database

CDB is incredibly memory hungry.  Peter Klausler caches the whole thing at once
in memory.  Fast, but expensive.  I would not try to import a file larger than
3/4 the size of your physical ram.  You can import larger, but it is not much
use.  I have a similar config (128 meg ram and 500 meg swap) and importing a 150
meg PGN file takes about 15 hrs.  I would not dream of importing rock or wall
with it.  What is _very_ useful is to take a large file like rock and split it
into ECO openings.  Import each of these, and they will fit.  You can do all
kinds of interesting experimentation with these.  I do wish that he would map
views of subsets of the file instead of the whole thing, but that would have a
performance cost for those that fit 100% without such windowing.



This page took 0.01 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.