Kissmetrics Blog

A blog about analytics, marketing and testing

Built to optimize growth. Track, analyze and engage to get more customers.

How to Look at Your Website the Way Google Does

When you spend months or years on a website, not to mention thousands of dollars, it’s hard to step back and look at it objectively. Can you look at it through the eyes of your users? Can you look at it the way Google does?

If you can look at your website the way Google does, you’ll probably discover areas in which your website needs work. So in that spirit, I’m going to teach you how you can see your website from Google’s perspective, and how you can then target the areas that need improvement.

First, Google finds your website

In order to see your website, Google needs to find it.

When you create a website, Google will discover it eventually. The Googlebot systematically crawls the web, discovering websites, gathering information on those websites, and indexing that information to be returned in searching.

You can help the Googlebot with this process, and you should. If you go through the steps below, your site will get indexed faster.

  • First, create a sitemap – a sitemap is a special document created just for search engines. If your site lacks a sitemap, you need to install one. WordPress users can install the Google Sitemap Generator for an easy but effective way to create one. Otherwise, you can use sites like to generate one. You’ll need to upload the site map file to your root directory.
  • Submit your website to Google Webmaster Tools – Google Webmaster Tools is the go-to resource for lots of valuable information. As a first step, you should sign your site up with Google Webmaster Tools to ensure that it’s being indexed and returned by Google. Once you’ve done this, it’s time to add your sitemap. In Google Webmaster Tools, click on your site. Then, navigate to “Crawl” and then “Sitemaps”. If there is no sitemap, click “Add/Test Sitemap” in the upper right corner. Add the sitemap you created in the step above.
  • Go the extra mile – if you want to go the extra mile, you can ask Google to index your site on the Webmaster Tool URL submission page.

Now that Google sees your website you need to find out what they’re going to see when they look at it.

Google doesn’t look at anything blocked by robots.txt

Your Robots.txt tells Google, “you can look at these sections of my site, but not these other sections.”

If there are any files, pages, or directories on your site that are disallowed, then Google will comply with your request by not indexing them. As a result, these pages will not be returned in search engine results.

A robots.txt can be as simple or complicated as you want. I recommend the simple approach.

All you need is a text file on your web server, titled robots.txt. Before looking at your site, it checks to see what it has permission to crawl. When Google comes crawling your site, it will look for this file.

The following robots.txt says, “Yes, go ahead. Crawl everything.” That’s because there is nothing listed after “disallow.”

User-agent: *

If you list anything after “Disallow:” then Google will not index that page or directory. For example:

Disallow: /trafficsystem/
Disallow: /wp-admin/
Disallow: /*?
Disallow: /*.css$

How can you tell if you have a robots.txt file?

Type in your URL, followed by /robots.txt. If you see a page like this, it’s a robots.txt file.

1 qs robots

You can also find out if Google is fetching robots.txt information by checking the main dashboard of your Google Webmaster Tools account.

2 GWT current status

If you have no robots.txt file, then Google will simply crawl and index your entire site. That might be okay. But if there are sections of your site that you prefer not to be crawled or indexed, you should create a robots.txt file, and list them.

Using a robots.txt can be a great way to block off sections of your website that are creating duplicate content. For instance, some content management systems will create extra pages for comments or unnecessary variations of webpages. If that is happening to your website, then block them off in your robots.txt file.

Google looks at your title

After checking your robots.txt file, Google looks at a nugget of content on your website — the page title. It’s a meta tag, enclosed by <title> in your page’s HTML code.

The title tag has been called “the single most important on-page SEO element”, and “the most important on page SEO factor”.

3 qs serp

Here’s how Google sees your title tag:

  • Google sees your entire title, but only 65 characters matter. Those 65 characters is what a user will see when your page appears in the search engine results pages (SERPs). For Quick Sprout, Google see’s “Quick Sprout – I’m Kind of a Big Deal” as shown in the image above.
  • Google sees all the titles on all your pages, and wants each one to be unique. Don’t give every page on your site the same title.
  • Google sees the keywords in the title, but doesn’t want to see keyword stuffing. In other words your title tag should contain more than just keywords.

Google looks at your description

After looking at your title, Google moves on to your page description.

The page description is another meta tag, this time enclosed by the <description> tag.

Although Google indexes your meta description, it doesn’t use it as a ranking factor. In other words, you’re not going to get higher rankings with some sizzling genius of a keyword-focused description tag. A description is there for your users, and Google looks at the description to display to users on the SERP.

4 KISSmetrics serp

You should include a meta description on each page, recognizing that Google looks at it, but doesn’t depend on it as a major ranking factor.

Make sure you write a brief meta description for each page, make it roughly 160 characters, and most important write it for humans and search engines.

Remember! This description is probably the only free advertising copy you get on the entire planet. So don’t gloss over it. Spend time crafting compelling descriptions that will increase your click-through rate.

Google can’t see what your images look like, but they look at alt tags to see what the image is about

Google is pretty good at looking at just about everything on your site. They’re even good at searching by image.

5 Google Search by Image

But for your site, alt tags on images are what truly matters. This is what Google indexes and uses as part of the search returns. Even though it can’t necessarily “see” the image, it sees what you provide in the alt tag.

An alt tag is part of the HTML code for any image on your site.

<img src=”” alt=”Keyword Phrase”>

The “keyword” in the line above is where you should provide a brief description of your image. Every single image needs this, and it needs to be a description that is related to the actual image.

In some CMSs, the alt tags are automatically generated. Sometimes, they are applied indiscriminately by someone who is not aware of proper alt tagging practices. The tags end up looking like this:





These are useless.

Instead, you should create alt tags for images that are descriptive, keyword smart, and useful. To make sure you have alt tags, simply look at your HTML code to see if there is information after alt= for each image.

You may want to check your robots.txt to make sure that you’re not disallowing images from being crawled on the site. Once you have images all nicely alt tagged, go ahead and let the crawlers loose on this valuable source of rank potential.

Here is an example of what you should not have on your robots.txt.

6 robots text file

What you need to do is add descriptive and keyword-sensitive alt tags to every image on your site. If you run an ecommerce website be sure you include any model or serial numbers in your alt tags.

Google looks at content

Now we’ve come to the most important aspect of what Google sees… your content.

By “content,” I mean everything that is unfettered by HTML code and displayed for users in all its glorious brilliance — undaunted by length requirements, and free to convey powerful, compelling, and useful information.

Content! I love it.

Every single word on your page is seen and indexed by Google. And the more content you have, the better. Google is not limited in how many pages of your website it will crawl, index, and return. It reaches everything.

I recommend that you have plenty of content on every page. You can’t go wrong with lots of content. But please, make sure that it’s quality content.

Not only does Google look at all your content, but they turn their Googlebot heads whenever you publish new content. That is why I insist on producing epic-length content every week, and why I suggest that you do the same.

Google’s fresh factor suggests that regular, new, and awesome content will get the Google look.


Taking a fresh look at your website from Google’s perspective helps you to break out of the rut of obsessing over the same old things on your site.

It’s likely that Google cares about some factors that are different from what you keep looking at. What I’ve listed above are the most important of those factors.

Why don’t you take a few minutes with your website, going through each of these factors. See if you can catch a glimpse of what Google is seeing. You might really improve your rankings.

What helps you look at your website the way Google does?

About the Author: Neil Patel is the cofounder of Neil Patel Digital.

  1. Hello Neil, great points there, I’m going to fix few things from my robots.txt file so thanks you :)

    I’ve question for you Neil.. But it is little off topic, still waiting on new post on Quicksprout.. What’s going on? :)

  2. Neil I am started to following u in every social media, i am studying your advanced link building strategy…..this has much information….for beginners…….I am expecting an article about Adsense..monetisation…

  3. Heath Emerson Apr 29, 2014 at 4:19 pm

    Great tips and a reminder that your website needs to be perfect. Including the way story portrays you.

  4. Such a detailed post neil great job!

  5. I hate Google sometimes haha but great job Neil. The article speak to me clearly.

  6. Google will not display the title provided in meta tag unless it is relevant to the content of your page, in this case Google will look for more relevant text from page’s content/sub-headings, look for popular incoming anchor text or use ODP text.

  7. robots.txt doesn’t pevent a url to be indexed. If the url is linked, Google will index it anyway with a message replacing the decription by a specific message “A description for this result is not available because of this site’s robots.txt”

  8. Hi Neil,

    Good post. I think title tags and meta descriptions are so overlooked by a lot of businesses – obviously, smaller businesses. It’s really an art to write them both, especially given that they both have character limits. Don’t you agree? :)

  9. Do the quotation marks you put around the alt tags make any difference?

  10. Hi Neil,

    This is all good but things could be more descriptive as we all know about Google recent design change that reduces the title/description character limit and many more. I totally agree with all your points but Google also check out the Robots tag, canonical tag, Hreflang, if modified since header and few more things while scanning the whole page.

    Moreover, I have recently wrote a blog on complete website SEO guide this contains all the on-page things that Google consider the most.

    I hope you like it and if you have any suggestion than please let me know

  11. Neil,

    Great points. Sitemaps are quick way to get the posts indexed by Google.

  12. Yes you are.

    It means Google is going to ignore your wordpress admin and includes folders. This is how it should be.

  13. Hi Neil,

    Really nice post, full of straightforward ideas and easy to implement!

    One question with regards the robots.txt file (it may be a little off topic!) and PPC. If creating multiple landing pages to A/B test a PPC campaign, would you suggest excluding these pages in the robots.txt file as these pages may only be specifically created for the purpose of the PPC campaign?

    Obviously if you have a main product / service page which is in general use on your website but is also a landing page for a PPC campaign, this would not be excluded from robots.txt. Really just the potential other test landing pages which may have been created…

    Apologies again for drifting off topic a little!


    • Tony, thanks for the feedback. Your insights were great. Please let us know if you need help with anything at all :)

  14. Nice post about sitemaps., Webmaster tool sitemaps are the best way for our site to Google index.

  15. Ummm.. The title tag isn’t a meta tag in code language it’s a title tag. There is a tag but it’s not the same.

    The tag doesn’t exist. It’s written as

  16. Very interesting, thanks, a few things I wasn’t expecting. This is why, with the SEOs you have employed, make sure they’re signed up to Google Authorship and use Google+ all the time. It ties everything together nicely.

  17. Thanks for sharing this awesome info, my robots.txt was actually messed up I had a lot of Disallows now all cleared up so guess now Google can crawl better.

  18. Hey neil,
    you mentioned important point. Submitting the sitemap to webmaster is very important process and everyone have to to it for indexing the site. Thanks for sharing these tips.

  19. This is really informative post about Google’s eye for website. It contain all information from basics and help also to improve the things so that website crawl in proper manner and can apply things effectively. Great post :-)

  20. Hi,

    Lots of important information to be learnt about how these little things can matter a lot while ranking high on Google’s pages. Thanks a lot for sharing such detailed information.

  21. The basics are explained in a easy and simple manner! Good guide for the beginners!

  22. Mayanki Baruah May 06, 2014 at 4:50 am

    Very nicely explained article. We all know about this simple things, but the way you have explained is just awesome. Liked reading it.

  23. Lefang Ntefang May 10, 2014 at 8:10 am

    This is great for us beginners.

    Thank you.

  24. Another great article, thank you!

    I will follow these steps when explaining SEO to our customers.


  25. Great Information For any website owner. Some techniques from the help we can Index our website Fastly.

  26. Hi Neil,
    Thanks for sharing this valuable article.

    I think it is important to note that video also could take part in a great content strategy. I have personally been experimenting with YouTube imbeds vs. own hosting, and am looking forward to writing a case on that.

  27. Awesome article. VERY helpful. Meanwhile, does Google see the following:

    Some sites have product info that contain images and descriptions that are pulled via a feed from another site. This is generally added via a short code or widget of some form. Does Google read those descriptions and count it as content you have added to your site? My feeling is NO it doesn’t. But I want to check as I have been asked this re someone who is looking for ways to optimise their site content, thank you

  28. Hi Neil,

    thanks for breaking it down so nicely for us, I checked my robots.txt file after reading it! One thing I’ve been wondering for a while now is if I have widgets on my home page, does Googlebot crawl, read or understand them? I’m using WordPress and I try to build every from shortcodes right on the page but sometimes I’m tempted to use a widget for a call to action text+button. Not sure if this is up your alley, let me know your thoughts!

  29. Grant Spolander Jan 27, 2017 at 3:58 am

    Hi Neil, huge fan! Quick question: Are directory websites frowned upon by google? Is the keyword directory a bad thing to have on your site?

    Thanks for all the tips!

  30. hi Neil,

    still very interesting in 2017 – i am just starting to get into this.
    one question: if i have a blog with relevant and real content in a subfolder of my domain, but no link to the blog on the home- and subpages of the actual website, will google see the blogs content and take it into account as if there would be a link from the homepage?
    i wouldn’t want everyone on my site to see the blog and just email the link if someone should see it.

    thanks a lot

    • By my experience Google will index your blog anyway, thats why you have to add this line: Disallow: /trafficsystem/ to robots.txt

  31. Hi Neil,

    I am always following your articles and videos and all are really great!
    The way you explain each and every stage in this article is very attractive and I completed more than one year in SEO industry but never know the deep process of google bots.


Please use your real name and a corresponding social media profile when commenting. Otherwise, your comment may be deleted.

← Previous ArticleNext Article →