Googlebot
From Wikipedia the free encyclopedia, by MultiMedia
A Googlebot is a search bot, used by Google. It
collects documents from the web to build a searchable index for the
Google search engine.
If a webmaster does not want to have any of the information on their
site downloaded by a Googlebot, they can do so by inserting a robots.txt
file, which can stop Googlebot and other web-crawling robots from
caching their site.
External Links
Google Guide made by MultiMedia | Free content and software
This guide is licensed under the GNU
Free Documentation License. It uses material from the Wikipedia.
|