Re: spiders ?
a spider is a program that searches the web for information to propagate search sites such as google, bing, yahoo, etc.
Only certain pages here are viewable by spiders. ( at least the ones that obey robots.txt and login/pass rights ) Technobabble for instance.
http://en.wikipedia.org/wiki/Web_crawler
__________________
68 Stat. 775, 50 U.S.C. 841-844
No members have liked this post.
|