Website Design Tips - Hypergurl

Google possibly spiders website pages separately on different dates, instead of spidering a website as a whole block all on the same date.

Web designers for months now have been using Google Webmaster Tools to check the dates that Google last spidered their website. From this date it is usually presumed that their website as a whole had been updated in the Google index for all to see. We've recently noticed this isn't always the case as pages seem to be spidered and indexed on different dates as I'll illustrate below.

A few days back I checked what pages were listed in the Google index by typing in their search box: site:www.hypergurl.com Try this with your own site and you'll find a list of all your pages within Google search.

Unless it is a new website, you should also find under each listing a linkable word that says: Cached

Follow that link and you'll then find something similar to this: This is Google's cache of http://www.hypergurl.com/ as retrieved on 30 Dec 2006 15:16:06 GMT.

Do that for quite a few of your website listings and if your anything like us you'll find many pages are retrieved by the Google spider on different dates. How is this useful for webmasters? It could save a lot of unnecessary stress worrying about why your newly added pages were not listed in the index after Google Webmaster Tools announces they had spidered your site on a certain date. It might be simply a matter of them not yet getting around to the new pages.