« remove photo background image | Main | Learn how to use Photoshop »

How google spider crawls the web

How Googlebot crawls the Internet

Here is an excellent video from Matt Cutts (head of Googles webspam team). In this video he uses colored candy to help describe how the Google spider crawls the web to find new website pages. Matt also goes on to illustrate how they find pages that are already listed and have been updated since the last spider.



Note: Red candy is a 404 page
Purple candy is a 200 (OK) page
Green candy is a 304 status code (page has not changed)



subscribe to Website Design Tips feed Want to learn more about designing a website or improving an existing one? Subscribe to Website Design Tips today for free.

Posted on January 22, 2007 10:05 AM |

Post a comment

(If you haven't left a comment here before, you may need to be approved by the site owner before your comment will appear. Until then, it won't appear on the entry. Thanks for waiting.)

Search

 
Add this blog to your feed Subscribe to this feed

About

This page contains a single entry from the blog posted on January 22, 2007 10:05 AM.

The previous post in this blog was remove photo background image.

The next post in this blog is Learn how to use Photoshop.

Many more can be found on the main index page or by looking through the archives.


copyright 2001-2007 © hypergurl.com