How Can You Help the Search Engines Find Your Website?

One of the most fundamental aspects of search engine optimization (SEO) is to ensure that the pages within your website are as accessible as possible to the search engines. It’s not only the homepage of a website that can be indexed, but all of the internal pages within a site’s structure. The internal pages of a site often contain important content such as products, services or general information, and therefore can be uniquely optimized for related terms. As a result, easy access to these pages is vital.

There are many do’s and don’ts involved in making sure all of your pages can be found by search engines. However, it is important to first establish how the search engines find and index web pages. You need to design your site before you begin to program your website.

Search engines use “robots” to find content on the web for inclusion in their index. A robot crawls hyperlinks on a web page and moves to the next web page through these hyperlinks. When a robot finds a document it includes the content within the search engine’s index, then follows the next link it can find and continues the process of crawling and indexing. With this in mind, it becomes apparent that the navigational structure of a website is important in getting as many pages as possible indexed.

When considering the navigational structure of your site, the hierarchy of content should be considered. Search engines judge what they feel to be the most important pages of a site when considering rankings and a page’s position in the site structure can influence this. The homepage is generally considered the most important page of a site – it is the top level document and usually attracts the most inbound links. From here, search engine robots can normally reach pages that are within three clicks of the homepage. Therefore, the most important pages should be one click away, the next important two clicks away and so forth.

The next thing to consider is how to link the pages together. Search engine robots can only follow generic HTML href links. This means that Flash links, JavaScript links, dropdown menus and submit buttons will all be inaccessible to robots. Links with query strings that have two or more parameters are also typically ignored, so be aware of this if you run a dynamically generated website.

The best links to use from an SEO perspective are generic HTML text links, as not only can they be followed by robots but the text contained in the anchor can be used to describe the destination page. Image links are also acceptable but the ability to describe the destination page is diminished because the alt attribute is not given as much ranking weight as anchor text.

The most natural way to organize content on a website is to categorize it. Break down your products, services or information into related categories and then structure this so that the most important aspects are linked to from the homepage. If you have a vast amount of information for each category then again you will want to narrow your content down further. This could involve having articles on a similar topic, different types of product for sale, or content that can be broken down geographically. Categorization is natural optimization ?›ƒ?ªƒ?? the further you break down your information the more content you can provide and the more niche key phrases there are that can be targeted.

If you are still concerned that the important pages may not get indexed, then you can consider adding a sitemap to your website. A sitemap can be best described as an index page ?›ƒ?ªƒ?? it is a list of links to all of the pages within a site contained on one page. If you link to a sitemap from your homepage then it gives a robot easy access to all of the pages within your site. Just remember ?›ƒ?ªƒ?? robots typically can’t follow more than 100 links from one page, so if your site is larger than this you may want to consider spreading your sitemap across several pages.

There are many considerations to make when optimizing your site for search engines, and making your pages accessible to search engine robots should be the first step of your optimization process. Following the advice above will help you make your entire site accessible and aid you in gaining multiple rankings and extra traffic.


Content is the most important part of having quality links to your website. With Area-Info.net, we provide a quality location to share your story and include links to your website to help you grow. If you would like to learn more, visit this page to see how you can use Area-Info.net to rank higher and quicker in search engines. Contact me directly at [email protected] with any questions, or to schedule speaking engagements.

You May Also Like

Leave a Reply