View Single Post
  #8  
Old 2007-05-09, 11:55 AM
guygee's Avatar
guygee guygee is offline
Non Serviam
 
Join Date: Feb 2005
Location: Astro Intergalactic Infinity
Re: Help!! Spiderbots crawling on my Threads!!!

Quote:
Originally Posted by U2Lynne
I have thought about not having the Torrent forums 'public' and thus keep out the spiders, but when it's been brought up before, no one has really had a strong opinion about 'closing' them and so I've just left them alone. It's simple for me to make them not 'spiderable', but really, if people are worried about what will show up on a search engine, I don't think it is the torrent threads they should worry about, it would be The Lounge/Politics threads.
Lynne - Priobably most torrent threads are fine, same goes for the technobabble threads. There are those exceptions, two of which I specifically pointed out. I have no idea if there is any way to lower the google priority once they are out there (a totally different issue, I imagine).

Personally, I vote on having the The Lounge/Politics threads being non-spiderable, but I leave that out there for discussion.

But consider this...one of the last calls for my professional research services was from somebody unofficially shilling for the NSA...calling for "advanced techniques for rapid data mining in constructing social network representations". Please chew on that one for awhile
__________________

Constantly choosing the lesser of two evils is still choosing evil. --Jerry Garcia
Reply With Quote Reply with Nested Quotes