SI
SI
discoversearch

We've detected that you're using an ad content blocking browser plug-in or feature. Ads provide a critical source of revenue to the continued operation of Silicon Investor.  We ask that you disable ad blocking while on Silicon Investor in the best interests of our community.  If you are not using an ad blocker but are still receiving this message, make sure your browser's tracking protection is set to the 'standard' level.
SI - Site Forums : Silicon Investor - Welcome New SI Members!

 Public ReplyPrvt ReplyMark as Last ReadFilePrevious 10Next 10PreviousNext  
To: Jeff Dryer who started this subject5/31/2003 11:03:38 PM
From: mmmary  Read Replies (2) of 32936
 
This ad has got to go! and robots.txt sucks!

You added this cheazy, sleazy, shaking ad. The decline has begun.

cdn.valueclick.com

I was going to post old versions of siliconinvestor but bob and matt have blocked it just like they blocked ihub so I can no longer show you where it said "basher free zone." Look at these robots. Now I bet he will make it so you can't search si via google so you have to pay for "premium" services just to get some of the old services back. And to think bob thinks these comments are "witty."

User-agent: ia_archiver
Disallow: /

# robots generally aren't so bad
User-agent: *
# legacy paths that will always give redirects to the current page anyway
Disallow: /~wsapi
Disallow: /investor
# duh, you can't reply
Disallow: /stocktalk/msg_reply.gsp
# quotes, charts, etc. don't have any useful info for robots
Disallow: /research/quote.gsp
Disallow: /research/chart.gsp
# some value for robots, but more expensive than it is worth
Disallow: /research/industrygrps.gsp
# robot can't have have a portfolio
Disallow: /portfolio
# robots shouldn't try to do anything
Disallow: /stocktalk/do.gsp
# all these are dupes of content available through other URLs
Disallow: /stocktalk/msg_multireplies.gsp
Disallow: /stocktalk/msgs.gsp
# robots can't have personal messages
Disallow: /msgcenter
Report TOU ViolationShare This Post
 Public ReplyPrvt ReplyMark as Last ReadFilePrevious 10Next 10PreviousNext