When understanding how Google indexes webpage’s is to think of the web as a large book and which has an impressive index which identifies where everything is located. When you query a search on Google, it checks their index of webpage’s they have compiled and determines the most relevant search results to be returned back to the user.

The three key processes in delivering search results to you are:

Crawling: Does Google know about your site? Can we find it? Indexing: Can Google index your site? Serving: Does the site have good and useful content that is relevant to the user’s search?

Crawling

Google use a process where automated software known as Googlebot skewers the internet for new and recently updated paged to be added to their index.

Google use a vast set of computers to fetch (or “crawl”) billions of webpage’s. The program which performs this amazing job is known as Googlebot. Other terms it’s also known as are robot, bot or spider. Googlebot uses an algorithmic process: computer programs determine which sites to crawls, how often, and how many pages they fetch from each site.

Indexing

When Googlebot begins to the crawl the internet it starts with a list of URL’s from previous sessions, and augmented with Sitemap data provided by webmasters. When Googlebot lands on a page it takes the links from that page and adds them to its list of pages to crawl. New websites or updates to new ones are noted and updated on the Google index.

The good thing to note here is that you cannot pay Google to crawl a site more frequently and is not part of their revenue generating services.

Googlebot processes each of the pages it crawls in order to compile a massive index of all the words it sees and their location on each page. In addition, Google processes information included in key content tags and attributes, such as Title tags and ALT attributes. Googlebot can process many, but not all, content types. For example, we cannot process the content of some rich media files, dynamic pages or iframes.

Serving results

When you query a search on Google, it takes your query and matches to relevant pages within their index and then displays the results in the order Google feels most benefits your query. Relevancy is determined by over 200 factors, one of which is Pagerank. Pagerank is based on the importance if the incoming Links from other sites. Each link from another site your own contributes to how well your page will rank. But don’t think you can go out and get 1000’s of incoming links by automatically submitting to sites. Not links are equal in Googles eyes. Google is working hard to ensure that you the user are provided the best result for your search by identifying spam links and other practices that have a negative impact on search results. What this means in simple terms, if you have a site which provides information on pet care and products, then your page rank will increase when getting incoming links from websites with similar interests and content.

Before Google can index and rank your site well in search results, you need to ensure that Googlebot can crawl and index your site properly. Broken and dead links will have a negative impact on how your site ranks. It’s important to ensure that you use Google webamstertools to not only ensure your site can be crawled but to also ensure you comply with Googles guidelines and improve your sites ranking.

Caching your Site

One of the major advantaged I find with Google caching the content of your website is that if you ever mistakenly save over your index.html page on either your main website or one of it’s subfolders your can retrieve that data without to much hassle through Googles Webmaster Tools.

1. Log into your Webmaster Tools Account.

2. Click on Statistics on the left hand side panel.

3. Click on Index Stats.

4. Then on

cache: The current cache of your site cache:yourdomain.com

From here it will show you a screen shot of the last time Googlebot crawled your webpage.

What you want to do from here is save that page.

1. Go to ‘File’ at the top right hand corner of  your browser.

2. Go down to ‘Save As’ and save it as index.html or index1 whatever you choose.

3. Use your FTP program to transfer it over to your Hosting Folder.

4. Using your Website Design Tool modify it from what Google has Cached then save back over your index.html file.

By this point you should your original Website which was lost should now be restored. At this point you may want to make a back up of it.

While Google has a strong focus on getting the best search results for users, it’s getting tougher all the time to get better results for your website with Google. for more help visit to:www.yourgoogleincome.com.Many smaller businesses with limited resources are likely to find themselves at a disadvantage due to the constant algorithm changes.

What will this latest change mean to you and your website? For some of you it will make very little difference, for others it will impact considerably because the number of pages from your website listed within Google’s search results will have diminished.

This article focuses on just one element of the March ‘06 “Big Daddy” update-the importance of getting external websites linked to yours, and how Google indexes websites across the internet.

Google uses link popularity as a measure to determine how often they will ‘crawl’ a website. Links have always been a strong measure of how Google ranks a website, but in the past this measure has been more geared towards determining PageRank and the order in which a web page is listed in Google search results.

What do I mean by indexing? Google uses an automated crawler called the Google to find websites across the internet. For new websites that are not currently indexed by Google, Google relies heavily on finding these new websites through links from existing websites within its current search database. For existing websites the Google visits websites already indexed within its database. If Google has already previously indexed a website, then it will generally be faster to index other pages within your website.

Google has introduced an additional complexity through its Big Daddy update. One thing many site owners have noticed since the end of March is that many pages from their websites have vanished from Google’s index. Google have said that with this recent update they are placing more weight on ‘crawling’ external links from websites that they classify as being important. The more external links you have pointing towards various pages within your site-not just your home page-, the more likely Google will crawl these pages and find other pages within your website.

Why are quality links so important? If Google doesn’t ‘crawl’ all your pages, then you will have no chance of having all your website content appear in Google’s search results. This means that you may have important information within your website that Google users will not find. At one stage it was enough to have your home page indexed and the rest of your website through a user-friendly website structure that the ‘crawler’ could follow. In the new environment however, that is no longer enough.

Note:” To show all of your results you will most likely need to click on the link of the last page that says     for more detail go to:www.youradsenseprofits.com.”repeat the search with the omitted results included”

External links pointing towards every single page within your website are not necessary, however make sure that external links point towards important pages within your website, and that your website structure is well linked to other parts of your website. The Google can easily crawl other pages from there.

An easy to follow navigation structure is vital for search engines, but more importantly for human visitors. Make sure that each page within your website has a clear link to the most relevant pages within the navigation structure. These individual pages should have clear links to relevant sub-pages. This way, you are satisfying both your visitors who are the most important when it comes to your website and the search engines.