Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Slightly OT programming question : searching a word/an expression

Author: Andrei Fortuna

Date: 17:18:59 06/11/02

Go up one level in this thread


I did some quick tests.
With MySql looks like I have to store the body message into a TEXT column in
order to use a FULLTEXT search and to have minimal storage but then :
     1) searches would be case insensitive (because such are TEXT types)
     2) no search against text is possible using wildcards if I understood the
documentation correctly (i.e. only plain word/expression searches) ...

Anyone has any ideas on how those could be fixed ?

I have one last thing to try - have my own parser to fill the word lists ... and
if I do this with decent storage requirements then I will be able to have it
100% in php and mysql :)

On June 11, 2002 at 18:32:55, Andrei Fortuna wrote:

>Aha ... yes, I have played with it too.
>According to my computations it would take 30 GB or more to store the whole text
>of all the messages. Because of the overhead, etc.
>
>If you can tell me how to create the database to keep the messages with minimum
>overhead (i.e. if I have 500 Mb of text in 200.000 messages I want it to take
>maximum 800 MB on harddisk not 30 GB) then I'll be eternally in your debt.
>
>
>On June 11, 2002 at 17:35:15, Adam Oellermann wrote:
>
>>Another random thought: MySQL (and many other databases, but you can probably
>>get MySQL most readily) supports full-text indexing and querying, which would
>>allow for very flexible searching without having to worry about building word
>>lists. I've played with this a little and would be happy to help if necessary.
>>
>>Regards
>>Adam
>>
>>On June 11, 2002 at 17:13:39, Dann Corbit wrote:
>>
>>>A notion:
>>>Put it in a SQL database and let us perform real searches against it.
>>>
>>>A simple wrapper could be put overtop for people who do not understand SQL.
>>>
>>>So (for instance) a list could say:
>>>All of the words: [                        ]
>>>And those would be combined with 'AND'
>>>and a second list could say:
>>>Any of the words: [                        ]
>>>And those would be combined with 'OR'
>>>
>>>There are many times when I know something is in the list and I could find it
>>>easily if I could form a SQL query against it.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.