By now if you spend any time online at all, particularly if you perform any task on the internet that has to do with search engine optimization, you may have seen the latest Matt Cutts video about Googlebots.
Matt Cutts is the head of the web spam team at Google, a highly sophisticated job that puts him at the forefront of the web community in terms of delivering to the online public important information. Mr. Cutts uses his position to post text and video blogs about the different activities of Google. Usually these posts are of the educational variety, but the latest post could almost be defined as a public service announcement.
There has been a lot of online speculation lately about Google’s spider program. This spider program is called Googlebot and crawls over pages on the web. Googlebot then reports back to Google about each page visited regarding the content of that page. Anyone that does work related to SEO knows about the Googlebots and understands why they crawl pages online. However, we do not know every characteristic of these spiders nor do we know everything in terms of how they respond to different sites.
Google states there are at least eight, possibly nine different Googlebots. There is evidence to suggest that as many as sixteen exist. That is ample opportunity for a page to be crawled numerous times and in many different ways.
If you have not seen the Matt Cutts video yet three of the five links provided below share the video. It is worthwhile watching to provide some clarity in regards to Googlebots. Thanks for reading, have a great weekend!
Coconut Headphones – Ted Ives – Google Crawling Behavior Exposed: 16 Different Googlebots?
Search Engine Watch – Mark Jackson – How Google ‘Handles’ SEO: My Beef With Matt Cutts