Iznervirao me noćas pa rekoh da postavim link
Više korisnih informacija na linku:
http://www.google.com/bot.html
Citat:Googlebot is Google's web-crawling robot. It collects documents from the web to build a searchable index for the Google search engine. On this page, you'll find answers to the most commonly asked questions about how our web crawler works.
As one of the premier search sites on the web, Google focuses on providing the highest-quality search results for our own users and for corporate partners such as America Online, Netscape, and the Washington Post.
|