Silicon Investor (SI) -- The First Internet Community

STOCKTALK

We've detected that you're using an ad content blocking browser plug-in or feature. Ads provide a critical source of revenue to the continued operation of Silicon Investor. We ask that you disable ad blocking while on Silicon Investor in the best interests of our community. If you are not using an ad blocker but are still receiving this message, make sure your browser's tracking protection is set to the 'standard' level.

SI - Site Forums : Silicon Investor - Welcome New SI Members! -- Ignore unavailable to you. Want to Upgrade?

To: mmmary who wrote (18246)	6/2/2003 10:13:28 AM
From: David Lawrence	Respond to of 32936

I'll repeat myself. That was done during INSP's watch.

To: mmmary who wrote (18246)	6/2/2003 11:54:50 AM
From: Quahog	Read Replies (2) \| Respond to of 32936

Here's your proof that SI has been blocking web.archive.org's robots since well before Bob came back: Message 16686004 To:mr.mark who started this subject From: Quahog Tuesday, Nov 20, 2001 2:55 PM Respond to of 7979 SI's robots.txt file: #---------------------------------------------------------- # no shoes, no shirt, no service User-agent: ia_archiver Disallow: / # robots generally aren't so bad User-agent: * # legacy paths that will always give redirects to the current page anyway Disallow: /~wsapi Disallow: /investor # duh, you can't reply Disallow: /stocktalk/msg_reply.gsp # quotes, charts, etc. don't have any useful info for robots Disallow: /research/quote.gsp Disallow: /research/chart.gsp # some value for robots, but more expensive than it is worth Disallow: /research/industrygrps.gsp # robot can't have have a portfolio Disallow: /portfolio # robots shouldn't try to do anything Disallow: /stocktalk/do.gsp # all these are dupes of content available through other URLs Disallow: /stocktalk/msg_multireplies.gsp Disallow: /stocktalk/msgs.gsp # robots can't have personal messages Disallow: /msgcenter #---------------------------------------------------------- web.archive.org.