I’m a research geek and I like to run 3-4 different analytics platforms at the same time to see how they measure up to each other. It’s a good system of checks and balances because when you need to give good or bad news about a website, you want to be sure the data is accurate.
I’ve been using Google Analytics for years and I also use Mint. Mint cost $30 and it was well worth it. Before Google Analytics did real-time data, Mint had it covered. I’d use Mint for the minute by minute updates and Google Analytics would be the muscle behind it to give historical data. **I also use ComScore and Quantcast, but since they don’t display hourly traffic, the info isn’t relevant for the purposes of this post.**
I finally got around to testing out Chartbeat about a month ago. It was really basic info, but presented in a very clean, easy to read dashboard. Since I started using it, I’ve had tons of obsessive fun watching the leader board of posts in real-time. It didn’t add much info that I didn’t already have from the other platforms, but the dashboard is great to keep handy. For $10/month after a free trial, you really can’t go wrong testing it out.
Today I noticed something strange on one of my sites. There was a relatively large traffic bump at around noon. I noticed this in my Mint dashboard and headed over to Chartbeat to see how it was doing. Huge surprise: Chartbeat didn’t notice the spike and thought traffic was lower WoW (week over week.)
Here’s Chartbeat’s data:
The blue line is today, the gray was last Tuesday.
Now here’s the data from Google Analytics. Same date/time range:
The blue line is today, the orange was last Tuesday. Notice anything different? How ’bout a huge spike that Chartbeat didn’t catch?
For the triple check, I pulled the data from Mint and made a graph in Excel. Mint doesn’t let you compare data ranges, so this is just from today.
Hmmm… That spike looks similar to what Google Analytics measured, but not Chartbeat. Let’s mash it all together.
This graph is not 100% scientific. The ranges don’t match up, but the trends should at least match. The most interesting part is that the grey line is Chartbeat’s data for last week and the orange line is Google Analytics’. Both report that the two hours prior to and post-spike were higher the previous week.
So the main question: today’s traffic spike was real. Why didn’t Chartbeat know about it? I know the traffic to this website is virtually non-existant compared to their other clients, but I have to question when a free platform and a piece of $30 software seems to be more accurate than a SaaS solution.