A cohort is a group of people who share a common characteristic or experience within a defined period of time.
Part of what distinguishes cohort analysis from other data analysis methods is that it allows you to track groups of people over long periods of time. In most cases, when you’re tracking data, everyone is blended together. You can segment people, but you can’t group them together and track their activity apart from other groups.
Why does this matter?
When you can put people into different groups based on their activity and track them over long periods of time, you will get an idea of what works and what doesn’t. For example:
- Did one group see one marketing message that the other didn’t?
- Are free trial users who submit support tickets more likely to convert to customers?
- Which features or products do customers keep coming back to use or buy?
- How “sticky” is your product for new users?
These questions can be answered with cohorts.
The One Major Advantage of Cohorts over Funnels
You’re probably thinking to yourself: Why not just use funnels to track conversions?
The big reason is that cohorts keep people separated over time. Funnel reports blend people together and can’t separate them. Use funnels for the primary purpose of identifying bottlenecks and roadblocks where people get stuck.
Let’s say you want to track how long it takes people to sign up after visiting your site. With a funnel report, the only thing you can do is select a date range and find the conversions within that time frame. In a cohort report, you can see the exact minute, hour, day, week, or month they converted.
Below is a simplified cohort report that tracks conversions from “visited site” to “signed up.” We’re using it to show you how cohorts work.
People are grouped by the month they visited, and they are split into buckets by the percentage of them who signed up each month:
On the left side of the report, we see six months (groups) along with the number of people who visited the site during that month. People are sorted by when they first visited the site. So, if someone visits in April and again in June (and doesn’t sign up), they’ll be kept in the April group.
On the right, we see the percentage of people in each group who signed up after they visited the site. They are sorted by month. If they visited the site and signed up within a month, they are put in the “1 month” bucket.
Viewing the data, we see that most people sign up within a month of visiting the site for the first time.
Putting people into these groups allows us to better understand the effectiveness of marketing activities. We see that April-June had higher first-month conversions. The July-September first-month conversions were not as strong, but 50% of the people who visited in August signed up within four months. If you were testing different marketing practices during those months, you’d see just how that marketing affected conversion rates.
The Kissmetrics Cohort Report
The core of Kissmetrics is its people-tracking platform. It doesn’t track sessions or visits. It tracks the real people who visit your site.
From the very first time a person visits your site until the last time, all the visits get counted and recorded as one person in Kissmetrics. As long as you have some way of identifying users, you can track people in Kissmetrics.
And, it doesn’t matter if the person visits your site on their tablet, phone, and/or desktop. Once the person is identified, all the visits merge and you’ll see exactly what the person did.
When running a cohort report, you’ll need to keep people straight. No one should be counted more than once, and no user activity should be automatically deleted after a certain time period. As we’ve seen, measuring cohorts can take months. If you’re using a platform that doesn’t track people or doesn’t remember them after a certain time period, you’ll end up with bad data.
Whichever cohort groups you use, you’ll need to be sure they are super accurate and data isn’t limited. What makes Kissmetrics’s Cohort Report so wonderful is that your data is accurate and the data doesn’t expire. It is exact and granular. You can drill down and see the exact people in each group and bucket. This allows you to reach out and get feedback from any user group you want to target. Without the people tracking you get in Kissmetrics, you wouldn’t have this flexibility.
Create a Cohort Report
To create a Kissmetrics Cohort Report, go to the “Reports” tab:
Go to “Create New Report” and select “Cohort Report”:
You’ll be presented with your report configuration:
This is where you set the parameters of what you want to track, as follows:
- Choose the two events you want to track. In the example above, we’re tracking the people who visited the site and converted to signed up. “Visited site” is an automatically tracked event, while “Signed up” is not. You’ll want to be sure to get your tracking set up and get many of your events and properties in place before you begin creating a report.
- The date range is not limited to 30 days. You can choose one week, two weeks, a month, ninety days, six months, twelve months, or you can pick a custom date range.
- Choose the time frame for the buckets you want to split the “Signed up” people into. We can split them by minute, hour, day, week, or month. What we split them by cannot exceed the date range. So, in our case, since we’re looking at the last 30 days, we cannot split them into months because that would exceed the 30-day range we’ve set.
- We can choose to count people who did the event “Signed up” every time or just the first time. Since people sign up only once, we’ll stick with “First Time Only.” (In some cases, you’ll want to choose “Every time.” For example, if you’re interested in tracking how often people log in, you’ll set it to “Every time.”)
- Choose whether to group people by time or property. Properties tell us various things about each person and are used to segment people. We’ll get into more detail later about which properties can help provide the best insights for specific reports.
- If we choose to group people by time, we can group them by day, week, or month. If we choose to group people by property, we’ll get four options:
These options apply to any property you choose. They are not exclusive to the Referrer property. Here are definitions/explanations of each of the four options:
- First – When this option is selected, you’ll be viewing the first ever occurrence of the property. In this example, we’re looking at the Referrer property, which groups people by the URL that referred them. Whatever their first referrer was, gets grouped here. So, if they first came to the site on July 4, 2012 from espn.com, they’ll be grouped by that referrer.
- Last – This will give you the most recent value for the property. In the case of the Referrer property, it’s the last site that the person came from regardless of the date range on the cohort.
- First (starting date range) – This referrer is the first one within the selected date range. The first ever referrer is ignored. Whoever the person’s first referrer was within the date range is the one used here.
- Last (ending date range) – In this sorting, people are grouped by the last referrer within the date range.
Before we run our report, we’ll change the date range to the last 6 months (step 2. above). This way, we’ll get a bigger sample size than we would from the last 30 days we previously set. Also, since the length of our date range is 6 months, we’ll make a change under “Advanced options.” We’ll group the people who did the event “Visited site” across months, not weeks (step 6. above). Here’s how the revised report configuration looks:
Run a Cohort Report and View Your Data
We’ll click “Run report” and get our data:
On the left, we’re looking at the number of people who visited the site during a specified month (group). To the right, we’re looking at the percentage of people who signed up after they visited the site (split into weekly buckets). Below the chart, we have a range of display options:
- Number of people – This display will show the number of people in each bucket. Use this if you don’t necessarily care about a strict conversion percentage and just want the raw numbers.
- Percentage of people – This is what we used in the above example. If you are interested in tracking conversion rates over time, use this.
- Cumulative number of people – When this option is chosen, each bucket will include the data before it. It will add up over time (assuming you don’t have 0) and give you the running totals. Use this when you want to see if the totals are increasing with each new batch of people.
- Cumulative percentage of people – The exact same as above, except with percentages. Use this to see how your conversion rate progresses through time.
We can hover over various buckets within the report to get a quick synopsis:
If we click on a bucket, we get the option to view the exact people who signed up during the time frame:
Remember, Kissmetrics connects all your data to real people. This means you can instantly pull a list of people who are in any particular cohort. To see who these people are, just click on the “View the 3 people” link, and you’ll get a list of the people and their email addresses.
Then, you can click on each person and get a person details report. (If you want to get more information on our person details report, check out our People, Events, and Properties post, which covers this in depth.)
Now that we’ve discussed how to set up and read the Kissmetrics Cohort Report, let’s get into detail about how these reports can benefit your business.
Use the Cohort Report to Measure Retention
Businesses live and die by their ability to acquire and retain customers. Acquisition and retention need to be balanced for a business to survive and grow. If you can’t do either well enough, growth will stagnate, and the business could eventually die.
So how do you avoid this?
In both acquisition and retention, the Kissmetrics Cohort Report is one of the best tools you’ll come across. It’s included in every Kissmetrics plan and is super easy to set up and use. Let’s run through some examples of how you can use this report to help you understand and improve your acquisition and retention.
Track Signup Rates
When tracking your signup conversion rates, you’ll want to use two separate reports:
- Funnel Report – Use this report to identify roadblocks to conversion.
- Cohort Report – Use this to put people into groups and learn the amount of time it takes them to convert.
To set up a cohort group for signup conversions, load the Cohort Report in Kissmetrics. Select the events “Visited Site” and “Signed Up”:
We’ll want to get a good sample size, so we’ll change our date range from the last 30 days (as shown above) to the last 12 months. We’ll also need to make a change under the “Advanced options”:
Since the length of our date range is 12 months, we’ll group people across months instead of weeks (as shown above):
We’ll click “Run report” and get our data:
We see that in every month (group) shown in the list on the left, the bulk of signups occurred within the first week. Any time after one week, there’s only a small chance of conversions.
The good news is that conversions improved as the months went by. In December, .3% of visitors converted to Signed up within the first week (bucket). Then, up until June, conversions stayed within .4% and .5%. Beginning with July, conversion rates nearly doubled from where they were previously.
Let’s change our “Visited site” grouping from time to property. We’ll look at the Channel property to see how different channels affect conversions. (We’ll look at the channel of the person’s first ever visit.) The Channel property categorizes your traffic referrals into 7 groups:
- Direct – Visits from direct referrers, typing your site into the browser, or bookmarks
- Organic – Visits from search engines
- Referral – Visits from other domains
- Email – Visits from emails
- Paid – Visits from paid sources such as cpc, cpm, display, ppc, and more
- Social – Visits from social networks/sites
- None – Anyone who doesn’t fit into any of the above channels will be put here
To get more concrete numbers, we’ll change the display option below the chart from “Percentage of people” to “Number of People”:
Viewing both the percentage of people and the number of people, we see that organic delivers the most visitors and the most signups. But, compared with the other channels, organic has an average conversion rate. Referral has more than double the percentage of conversions of any other channel.
Actions to Take Based on These Insights
Given that referral is such a strong group in the Channel property, you’ll need to do what you can to increase the number of referrals you get from other sites. PR, outreach campaigns, and guest blogging should all be in the cards.
Measure Login Retention after Signup
Let’s say you’re a SaaS company and you want to know how many people log back in after signing up. This will help you understand the “stickiness” of your product and the effectiveness of your new user onboarding.
To start, load the Cohort Report and select the events “Signed Up” and “Logged In.” These events are not automatically tracked in Kissmetrics, so you’ll have to set them up yourself.
This report will show us the people who visited the site and eventually signed up.
Since we’re interested in new user login retention, we’ll change our date range to the last 90 days. We’ll also take a look at the Advanced options:
Since the length of our date range is only 90 days, we’ll split people into daily buckets.
We’ll count people who “Logged in” “Every time” (instead of “First Time Only” as shown above).
We’ll group people who “Signed up” across weeks.
We’ll click “Run report” and get our data:
On the left side, we’re grouping people who signed up by week. We see a week (group) along with the number of people who signed up during that week. On the right, we see the percentage of people who logged in after signing up (split into weekly buckets). We selected “Every time” under the Advanced options, so we’re tracking each time a person logs in.
It’s not surprising that most people log in the same day they sign up. But, after the first day, we see a big drop off, and the retention continues to drop off as the days go by. The “>12” column is the percentage of people who continue to log in after 12 days of signing up.
To get more insight out of this report, let’s group those people who signed up by the plan they selected. To do this, we go back to our report setup (report configuration). Under Advanced options, we go to our options for the way we group people. We change the way we group people from time to property, and we select “Subscription plan level” as our property. This property is not automatically tracked in Kissmetrics, so you’ll have to set it up yourself. (We’ll look at the Subscription plan level of the person’s first ever plan.)
Here, we have all the plans (groups) listed along with the number of people in each plan. On the far right, we see that our top four plans have relatively solid engagement, with anywhere from 35.8% to 70.6% of people continuing to log in after 12 days of signing up.
The other plans have a much smaller sample size. We shouldn’t pay too much attention to those because they make up a small percentage of users, and there really aren’t enough people in those groups to get reliable insights. To make informed decisions based on data, we’ll definitely need more than 10 people in each group.
The Basic plan has solid retention. The majority of people who sign up for this plan are still logging in 12 days later.
Medium and Professional plans both have a good number of users; but after 12 days, their retention isn’t as solid as the Basic plan.
Actions to Take Based on These Insights
To get inactive users logging in with the product, you could send them emails asking if they have any questions or feedback. You also could test a new onboarding system to try to get more people logging in and getting use out of the product.
Track Repurchase Rate
Repurchase rate is a critical retention metric for ecommerce companies. It tracks how often a customer repurchases and really signifies how solid your business is in terms of service and pricing. Also, it can warn you ahead of time if purchases begin to dwindle.
We’ll track the event “Purchase” twice. This event is not automatically tracked in Kissmetrics, so you’ll have to set it up yourself. We’ll set our date range at the last 12 months. For ecommerce companies, repurchase rates can vary greatly depending on industry. If you sell diapers, you’ll ideally have a much higher repurchase rate than a company selling windows.
Under Advanced options, we’ll split people into weekly buckets. Again, this really depends on the type of ecommerce store.
Since we’re tracking the repurchase rate, we’ll need to count “Every time” a person purchases.
We’ll group people by time across months.
Now, let’s click on “Run report” and get our data:
We see that customers who purchased in December had a high likelihood of repurchasing in the weeks afterward. For the bulk of the other months (groups), repurchases are high within the first few weeks; but after that, they fall to around 5%. Then, after 12 weeks, repurchases reach slightly above 10%.
Keep in mind that we’re counting every time a person purchases. If they purchased in January and then they purchased again 2 weeks later and 6 weeks later, they’ll be counted in both the 2nd and 6th buckets.
To get more insight out of this report, let’s group people by product category to see if any category increases the likelihood of repurchase. To do this, we go back to our report setup (report configuration). Under Advanced options, we go to our options for the way we group people. We change the way we group people from time to property, and we select “Product Category” as our property. (We’ll look at the product category of the person’s first ever purchase.)
This data is grouping people by their product category. We see the most popular categories at the top, with the majority of people ordering button-ups. Pajamas, belts, shoe laces, and button-ups are some of our most popular repurchase items.
Actions to Take Based on These Insights
The data reveals the most popular product categories that lead to consistent repurchasing. You may want to consider expanding these product categories by adding more products and promoting them more aggressively through emails and paid channels. You also could feature them more throughout the site. Trying these tactics will likely lead to increased sales.
The Three Takeaways You Need to Know about Cohorts
A quick summary of the main points:
- Cohorts allow you to track and group people over long periods of time. This makes cohorts a great tool for tracking conversions. Funnels do not separate people over time. They throw them all under one umbrella. Use funnels to identify the roadblocks to conversion.
- Cohorts can provide insights for both acquisition and retention. SaaS companies can track signup rates, feature engagement, upgrade rates, and whatever else matters to their business. Ecommerce companies can track purchase rates, repurchase rates, and acquisition time (add to cart > purchase), etc. Slice and dice your data by time or property to maximize your insights.
- The Kissmetrics Cohort Report is awesome because it tracks people, the data is accurate, and the data doesn’t expire. This makes it possible to look as far as you’ve been tracking to see how behaviors have changed over time. You don’t need to worry about accuracy because Kissmetrics ties all your data to real people. In view of that, you can get very granular with your data and see each person in a report. Rest easy knowing you don’t have time constraints on your data and it’s all accurate.
Want to see the Cohort Report in action? Just click play below.
To find out your true conversion rates, login or sign up for a Kissmetrics account now.