hostmonster-Host Unlimited Domains on 1 Account   coolhandle offering reliable webhosting since 2001
Unlimited Hosting Space - FREE Site Builder   Smart Website Solutions for Your Small Business=

Google: how to optimize the crawl budget of your website

Pages with session ID’s:
If the same page can be accessed
with multiple session ID’s, use the rel=canonical attribute on these
pages to show Google the preferred version of the page. The same
applies to all other duplicate content pages on your site, for example
print versions of web pages. The duplicates will be ignored then.

Faceted navigation (filtering by color, size, etc.):

Filtering pages by color, size and other criteria can also lead to a
lot of duplicate content. Use the robots.txt file of your site to make
sure that these duplicates aren’t indexed.

Soft 404 pages:
Soft 404 pages are error pages
that show a “this page was not found” error message with the
wrong HTTP
status code “200 OK”. These error pages should use the HTTP status code
“404 not found”.

Infinite spaces:
For example, if your website has a
calender with a “next month” link, Google could follow these “next
month” links forever. If your website contains automatically created
pages that do not really contain new content, add the rel=nofollow
attribute to these links.

Low quality and spam content:
Check if there are pages on
your website that aren’t that good. If your website has very many
pages, removing these pages can result in better rankings.

Article source:


Submit a Review

If you want a picture to show with your review, go get a Gravatar.

1&1 has shared hosting and dedicated hosting solutions for every budget and free domains with all hosting packages!  StartLogic - Affordable hosting: Free setup/domain, unlimited emails, PHP, mySQL, CGI, FrontPage. As low as $3.95/month
Cloud ecommerce platform delivers more traffic, higher conversion and unmatched performance

© Copyright 2008 Tyconia International, Inc. All Rights Reserved.