SI
SI
discoversearch

We've detected that you're using an ad content blocking browser plug-in or feature. Ads provide a critical source of revenue to the continued operation of Silicon Investor.  We ask that you disable ad blocking while on Silicon Investor in the best interests of our community.  If you are not using an ad blocker but are still receiving this message, make sure your browser's tracking protection is set to the 'standard' level.
SI - Site Forums : Silicon Investor - Welcome New SI Members!
 Public ReplyPrvt ReplyMark as Last ReadFilePrevious 10Next 10PreviousNext  
To: Green Receipt who wrote (18910)6/26/2003 2:10:28 PM
From: SI Bob  Read Replies (3) of 32871
 
A little more in-depth explanation of how message search (currently) works.

Messages are stored in CLOB fields on the main database server. A Perl script running on a separate machine (the one Laurin's going to try to take to the ISP today) parses the words in messages and stores them on yet another box. A Windoze machine running MySQL.

When you submit a search, it goes to the MySQL box to get the message numbers then goes to the main database server to retrieve those messages.

It's looking more likely that when I'm done, the search will end up working in a similar way. On iHub, we use the full-text indexing feature of W2K/SQLServer2K, with searching handled by the main (only) database server. That's fine on a site with about a million messages. I don't think it will be on a site with nearly 20 times as many. The cache would be in a nearly perpetual polluted state doing it that way.
Report TOU ViolationShare This Post
 Public ReplyPrvt ReplyMark as Last ReadFilePrevious 10Next 10PreviousNext  

HomeMailHotSubjectMarksPeopleMarksKeepersSettings
Terms Of UseContact UsCopyright/IP PolicyPrivacy PolicyAbout UsFAQAdvertise on SI
© 2025 Knight Sac Media.  Data provided by Twelve Data, Alpha Vantage, and CityFALCON News