SI
SI
discoversearch

We've detected that you're using an ad content blocking browser plug-in or feature. Ads provide a critical source of revenue to the continued operation of Silicon Investor.  We ask that you disable ad blocking while on Silicon Investor in the best interests of our community.  If you are not using an ad blocker but are still receiving this message, make sure your browser's tracking protection is set to the 'standard' level.
SI - Site Forums : Silicon Investor - Legacy Interface Discussion (2004-2011) -- Ignore unavailable to you. Want to Upgrade?


To: SI Bob who wrote (2658)11/24/2004 7:55:22 PM
From: Sam Citron  Read Replies (1) | Respond to of 6035
 
I can tell anytime an Advanced Search has been run because there's always a blip in utilization up to about 10% rather than the 4% the db server usually runs at.

If you have these kind of scalability problems even after 16 months of working on the problem, I can see why you want to ration demand for advanced search. I just figured that if Google can search hundreds of millions of pages seemingly effortlessly, it should not be too hard to search a couple of million messages for a boolean expression. But I remember from taking a DB class 25 years ago that if the original system is not indexed in a certain way, it can be hard to modify it. I can only imagine the complexity of the retrofit project that you have just finished and don't mean to minimize your accomplishment. I simply want to understand why with storage and processing power getting cheaper all the time, it so hard to enable thousands of users to do advanced searches without bringing down the system? If it takes writing an entirely new system that is scalable, that is what obviously needs to be done, so far as I can understand. How can you plan for growth if the system lacks scalability?

Sam