How to Look at Your Website the Way Google Does

When you spend months or years on a website, not to mention thousands of dollars, it’s hard to step back and look at it objectively. Can you look at it through the eyes of your users? Can you look at it the way Google does?

If you can look at your website the way Google does, you’ll probably discover areas in which your website needs work. So in that spirit, I’m going to teach you how you can see your website from Google’s perspective, and how you can then target the areas that need improvement.

First, Google finds your website

In order to see your website, Google needs to find it.

When you create a website, Google will discover it eventually. The Googlebot systematically crawls the web, discovering websites, gathering information on those websites, and indexing that information to be returned in searching.

You can help the Googlebot with this process, and you should. If you go through the steps below, your site will get indexed faster.

  • First, create a sitemap – a sitemap is a special document created just for search engines. If your site lacks a sitemap, you need to install one. WordPress users can install the Google Sitemap Generator for an easy but effective way to create one. Otherwise, you can use sites like xml-sitemaps.com to generate one. You’ll need to upload the site map file to your root directory.
  • Submit your website to Google Webmaster Tools – Google Webmaster Tools is the go-to resource for lots of valuable information. As a first step, you should sign your site up with Google Webmaster Tools to ensure that it’s being indexed and returned by Google. Once you’ve done this, it’s time to add your sitemap. In Google Webmaster Tools, click on your site. Then, navigate to “Crawl” and then “Sitemaps”. If there is no sitemap, click “Add/Test Sitemap” in the upper right corner. Add the sitemap you created in the step above.
  • Go the extra mile – if you want to go the extra mile, you can ask Google to index your site on the Webmaster Tool URL submission page.

Now that Google sees your website you need to find out what they’re going to see when they look at it.

Google doesn’t look at anything blocked by robots.txt

Your Robots.txt tells Google, “you can look at these sections of my site, but not these other sections.”

If there are any files, pages, or directories on your site that are disallowed, then Google will comply with your request by not indexing them. As a result, these pages will not be returned in search engine results.

A robots.txt can be as simple or complicated as you want. I recommend the simple approach.

All you need is a text file on your web server, titled robots.txt. Before looking at your site, it checks to see what it has permission to crawl. When Google comes crawling your site, it will look for this file.

The following robots.txt says, “Yes, go ahead. Crawl everything.” That’s because there is nothing listed after “disallow.”

User-agent: *
Disallow:

If you list anything after “Disallow:” then Google will not index that page or directory. For example:

Disallow: /trafficsystem/
Disallow: /wp-admin/
Disallow: /*?
Disallow: /*.css$

How can you tell if you have a robots.txt file?

Type in your URL, followed by /robots.txt. If you see a page like this, it’s a robots.txt file.

1-qs-robots

You can also find out if Google is fetching robots.txt information by checking the main dashboard of your Google Webmaster Tools account.

2-GWT-current-status

If you have no robots.txt file, then Google will simply crawl and index your entire site. That might be okay. But if there are sections of your site that you prefer not to be crawled or indexed, you should create a robots.txt file, and list them.

Using a robots.txt can be a great way to block off sections of your website that are creating duplicate content. For instance, some content management systems will create extra pages for comments or unnecessary variations of webpages. If that is happening to your website, then block them off in your robots.txt file.

Google looks at your title

After checking your robots.txt file, Google looks at a nugget of content on your website — the page title. It’s a meta tag, enclosed by <title> in your page’s HTML code.

The title tag has been called “the single most important on-page SEO element”, and “the most important on page SEO factor”.

3-qs-serp

Here’s how Google sees your title tag:

  • Google sees your entire title, but only 65 characters matter. Those 65 characters is what a user will see when your page appears in the search engine results pages (SERPs). For Quick Sprout, Google see’s “Quick Sprout – I’m Kind of a Big Deal” as shown in the image above.
  • Google sees all the titles on all your pages, and wants each one to be unique. Don’t give every page on your site the same title.
  • Google sees the keywords in the title, but doesn’t want to see keyword stuffing. In other words your title tag should contain more than just keywords.

Google looks at your description

After looking at your title, Google moves on to your page description.

The page description is another meta tag, this time enclosed by the <description> tag.

Although Google indexes your meta description, it doesn’t use it as a ranking factor. In other words, you’re not going to get higher rankings with some sizzling genius of a keyword-focused description tag. A description is there for your users, and Google looks at the description to display to users on the SERP.

4-KISSmetrics-serp

You should include a meta description on each page, recognizing that Google looks at it, but doesn’t depend on it as a major ranking factor.

Make sure you write a brief meta description for each page, make it roughly 160 characters, and most important write it for humans and search engines.

Remember! This description is probably the only free advertising copy you get on the entire planet. So don’t gloss over it. Spend time crafting compelling descriptions that will increase your click-through rate.

Google can’t see what your images look like, but they look at alt tags to see what the image is about

Google is pretty good at looking at just about everything on your site. They’re even good at searching by image.

5-Google-Search-by-Image

But for your site, alt tags on images are what truly matters. This is what Google indexes and uses as part of the search returns. Even though it can’t necessarily “see” the image, it sees what you provide in the alt tag.

An alt tag is part of the HTML code for any image on your site.

<img src=”http://www.example.com/picture.png” alt=”Keyword Phrase”>

The “keyword” in the line above is where you should provide a brief description of your image. Every single image needs this, and it needs to be a description that is related to the actual image.

In some CMSs, the alt tags are automatically generated. Sometimes, they are applied indiscriminately by someone who is not aware of proper alt tagging practices. The tags end up looking like this:

alt=”image001″

alt=”headerimg-gif”

alt=”CANONDSC019919F80009″

alt=”file01-smiling-boy-2014-04-17″

These are useless.

Instead, you should create alt tags for images that are descriptive, keyword smart, and useful. To make sure you have alt tags, simply look at your HTML code to see if there is information after alt= for each image.

You may want to check your robots.txt to make sure that you’re not disallowing images from being crawled on the site. Once you have images all nicely alt tagged, go ahead and let the crawlers loose on this valuable source of rank potential.

Here is an example of what you should not have on your robots.txt.

6-robots-text-file

What you need to do is add descriptive and keyword-sensitive alt tags to every image on your site. If you run an ecommerce website be sure you include any model or serial numbers in your alt tags.

Google looks at content

Now we’ve come to the most important aspect of what Google sees… your content.

By “content,” I mean everything that is unfettered by HTML code and displayed for users in all its glorious brilliance — undaunted by length requirements, and free to convey powerful, compelling, and useful information.

Content! I love it.

Every single word on your page is seen and indexed by Google. And the more content you have, the better. Google is not limited in how many pages of your website it will crawl, index, and return. It reaches everything.

I recommend that you have plenty of content on every page. You can’t go wrong with lots of content. But please, make sure that it’s quality content.

Not only does Google look at all your content, but they turn their Googlebot heads whenever you publish new content. That is why I insist on producing epic-length content every week, and why I suggest that you do the same.

Google’s fresh factor suggests that regular, new, and awesome content will get the Google look.

Conclusion

Taking a fresh look at your website from Google’s perspective helps you to break out of the rut of obsessing over the same old things on your site.

It’s likely that Google cares about some factors that are different from what you keep looking at. What I’ve listed above are the most important of those factors.

Why don’t you take a few minutes with your website, going through each of these factors. See if you can catch a glimpse of what Google is seeing. You might really improve your rankings.

What helps you look at your website the way Google does?

About the Author: is the Chief Evangelist of KISSmetrics and blogs at Quick Sprout.

  1. Hello Neil, great points there, I’m going to fix few things from my robots.txt file so thanks you :)

    I’ve question for you Neil.. But it is little off topic, still waiting on new post on Quicksprout.. What’s going on? :)

  2. Neil I am started to following u in every social media, blogs..now i am studying your advanced link building strategy…..this has much information….for beginners…….I am expecting an article about Adsense..monetisation…

  3. Heath Emerson Apr 29, 2014 at 4:19 pm

    Great tips and a reminder that your website needs to be perfect. Including the way story portrays you.

  4. Such a detailed post neil great job!

  5. I hate Google sometimes haha but great job Neil. The article speak to me clearly.

  6. Google will not display the title provided in meta tag unless it is relevant to the content of your page, in this case Google will look for more relevant text from page’s content/sub-headings, look for popular incoming anchor text or use ODP text.

  7. robots.txt doesn’t pevent a url to be indexed. If the url is linked, Google will index it anyway with a message replacing the decription by a specific message “A description for this result is not available because of this site’s robots.txt”

  8. Hi Neil,

    Good post. I think title tags and meta descriptions are so overlooked by a lot of businesses – obviously, smaller businesses. It’s really an art to write them both, especially given that they both have character limits. Don’t you agree? :)

  9. Do the quotation marks you put around the alt tags make any difference?

  10. Hi Neil,

    This is all good but things could be more descriptive as we all know about Google recent design change that reduces the title/description character limit and many more. I totally agree with all your points but Google also check out the Robots tag, canonical tag, Hreflang, if modified since header and few more things while scanning the whole page.

    Moreover, I have recently wrote a blog on complete website SEO guide http://theninehertz.com/complete-website-seo-guide-part-1/ this contains all the on-page things that Google consider the most.

    I hope you like it and if you have any suggestion than please let me know

  11. Neil,

    Great points. Sitemaps are quick way to get the posts indexed by Google.

  12. Yes you are.

    It means Google is going to ignore your wordpress admin and includes folders. This is how it should be.

  13. Hi Neil,

    Really nice post, full of straightforward ideas and easy to implement!

    One question with regards the robots.txt file (it may be a little off topic!) and PPC. If creating multiple landing pages to A/B test a PPC campaign, would you suggest excluding these pages in the robots.txt file as these pages may only be specifically created for the purpose of the PPC campaign?

    Obviously if you have a main product / service page which is in general use on your website but is also a landing page for a PPC campaign, this would not be excluded from robots.txt. Really just the potential other test landing pages which may have been created…

    Apologies again for drifting off topic a little!

    Thanks.

    • Tony, thanks for the feedback. Your insights were great. Please let us know if you need help with anything at all :)

  14. Nice post about sitemaps., Webmaster tool sitemaps are the best way for our site to Google index.

  15. Ummm.. The title tag isn’t a meta tag in code language it’s a title tag. There is a tag but it’s not the same.

    The tag doesn’t exist. It’s written as

  16. Very interesting, thanks, a few things I wasn’t expecting. This is why, with the SEOs you have employed, make sure they’re signed up to Google Authorship and use Google+ all the time. It ties everything together nicely.

  17. Thanks for sharing this awesome info, my robots.txt was actually messed up I had a lot of Disallows now all cleared up so guess now Google can crawl better.

  18. Hey neil,
    you mentioned important point. Submitting the sitemap to webmaster is very important process and everyone have to to it for indexing the site. Thanks for sharing these tips.

  19. This is really informative post about Google’s eye for website. It contain all information from basics and help also to improve the things so that website crawl in proper manner and can apply things effectively. Great post :-)

  20. Hi,

    Lots of important information to be learnt about how these little things can matter a lot while ranking high on Google’s pages. Thanks a lot for sharing such detailed information.

  21. The Basics are explained in a easy and simple manner! Good guide for the beginners!

  22. Mayanki Baruah May 06, 2014 at 4:50 am

    Very nicely explained article. We all know about this simple things, but the way you have explained is just awesome. Liked reading it.

  23. I have two websites, if I post duplicate content will this impact SEO for both sites, impact one site or have no impact whatsoever?

    Deep thanks!

  24. Lefang Ntefang May 10, 2014 at 8:10 am

    This is great for us beginners.

    Thank you.

  25. Another great article, thank you!

    I will follow these steps when explaining SEO to our customers.

    Justine

  26. Great Information For any website owner. Some techniques from the help we can Index our website Fastly.

55 comments

Please use your real name and a corresponding social media profile when commenting. Otherwise, your comment may be deleted.

← Previous ArticleNext Article →