Utilizing SiteMaps for SEO

These days web designers are giving up fast load times and correct coding for more visually stunning sites which is a huge mistake for Search Engine Optimization and they have to compensate for it by using services like Google AdWords and paying huge $$ just to get hits. Some sites are still using a splash page or other types of intro pages because of this, yet it doesnt help much because splash pages usually have little or no content for search engines to read and only one link to follow. Todays search engines are overloaded because of the sheer number of websites and pages on the internet so sometimes search engines will skip pages contained in a site even if they have the proper meta tags indicating that the pages should be indexed and links followed.

There are things about your web pages that search engine robots evaluate to determine if they should continue to index the page and follow links, without getting too technical a few of these are load time and correct coding. If your pages load slowly or the robot is having trouble reading through your code it is trained not to waste alot of time trying to sort it out so it will start skipping pages. There are also elements beyond our control like search engine scans that are not intended to look at every page and differs greatly depending on the company and what that specific robots tasks are.

There are a few things you can do to ensure you get more of your pages listed and probably the most effective is the use of Sitemaps. This method is a request or instruction to let the search engine robots know that you would like more pages to be scanned. For along time on my site Google and Alexa had only indexed the main page and skipped over the rest of the site until I put in a Google sitemap. You really should use 4 types of sitemaps.

Google xml sitemap (google.xml)
Generic xml sitemap (sitemap.xml)
Text sitemap for Yahoo (urllist.txt)
HTML sitemap (sitemap.html)

First make a Google sitemap here: AuditMyPC Google Sitemaps Its free and will make you a Google specific sitemap. Next register the sitemap with Google here: Google Sitemaps. You will need to have a Google account to submit your sitemap, you need to create an account so you can tell google where the sitemap is located, what the name of it is and verify that this is your site. This will tell the Googlebots when they visit your site that it needs to look at these other pages as well. Name this sitemap google.xml because you need one other xml sitemap for the other search engines and it should be named sitemap.xml.

To make the generic xml sitemap for other SE’s go here: AuditMyPC Generic Sitemaps and make another sitemap, this time naming it sitemap.xml. and when its finished crawling export it as an xml file. Also in this generator export another txt version of the file and name it urllist.txt. This is for Yahoo.

You should name the generic xml sitemap sitemap.xml because some search engines scan for an XML file with this specific name. For Google it doesnt matter what the name is because you will specify the file name when you register it. The Yahoo sitemap must be named urllist.txt and once you have that made you can submit it here: Yahoo Website Submission. You will need to have a Yahoo account to do this so if you dont have one already you will have to create a Yahoo account. You can submit the txt sitemap as well as the main site and/or individual pages.

The 4th Sitemap you should have is the html version. You can make that with this: AuditMyPC SiteMaps The same generator you used for the generic xml sitemap. It isnt redundant to do this either. Alot of people and SE bots look for this file as well and is provided as a courtesy to your users who may have trouble with navigation menus or find them confusing. Plus it gets you anotehr page indexed that contains all of your links.

This all sounds like alot but it will ensure that pages in your site arent overlooked by the already overloaded search engine bots.

* * * * * 1 Vote

Written by Kelly Welsh on July 23rd, 2006 with no comments.
Read more articles on Search Engine Optimization.