Nov 04

This posting taken from Google Webmaster Central

Crawling

Crawling is the process by which Googlebot discovers new and updated pages to be added to the Google index.

We use a huge set of computers to fetch (or “crawl”) billions of pages on the web. The program that does the fetching is called Googlebot (also known as a robot, bot, or spider). Googlebot uses an algorithmic process: computer programs determine which sites to crawl, how often, and how many pages to fetch from each site.
Continue reading »

written by admin \\ tags: , , , ,

Nov 04

This posting taken from Google Webmaster Central

Design and content guidelines

# Make a site with a clear hierarchy and text links. Every page should be reachable from at least one static text link.

# Offer a site map to your users with links that point to the important parts of your site. If the site map is larger than 100 or so links, you may want to break the site map into separate pages.
Continue reading »

written by admin \\ tags: , , , , , ,