Analytic troubleshooting: narrow the data scope

/

Twice in the last 24 hours, I had trouble with analytics — once with Omniture’s SiteCatalyst and once with Google Analytics. Both times, I “solved” the problem (more accurately, finally understood it) by making my time period shorter and shorter. But I’ll only show the Omniture example.

The Omniture/SiteCatalyst problem was that the customer was seeing more orders than items put into the shopping cart. So even if everyone only bought one item (somewhat unlikely), and everyone checked out (incredibly unlikely), there still weren’t enough items to justify all those purchases. We had already verified that the purchase numbers were pretty good, and it wasn’t that hard to see that items put into the checking cart, as a percent of visits, was incredibly low compared to recent history.

“So when did this start?” asked Omniture LiveSupport (a question I should have asked myself.)

I pulled a report for the last 60 days and found this:

You can see the crash on August 1, and when I “zoomed in” on August 1 and did a report by hour, I was able to find exactly when it happened. IT tied it to the change that they made. (By the way, the report is Commerce > Shopping Cart > Cart Additions.)

Now, this seems very straightforward. I had a similar program with Google Analytics (and that one is actually being reported as a change request, or a bug), but only by narrowing and narrowing my parameters was I able to delete enough variables to understand that the problem was truly a GA bug.

Time isn’t the only parameter to use when troubleshooting but it sure is a great place to start.

Robbin Steif
LunaMetrics

Our founder, Robbin Steif, started LunaMetrics in 2004. She is a graduate of Harvard College and the Harvard Business School, and has served on the Board of Directors for the Digital Analytics Association. Robbin is a winner of a BusinessWomen First award, as well as a Diamond Award for business leadership. In 2017, Robbin sold her company to HS2 Solutions and has since retired from LunaMetrics.

  • Sébastien

    I just discover your blog.

    I’m new in web analysing and I find it perfect to get started and get the pulse of the industry.

  • Well great! Enjoy. There are a number of other great blogs out there, you might just want to look at my blogroll and start there.

    Robbin

Contact Us.

Follow Us

1.877.220.LUNA

1.412.381.5500

getinfo@lunametrics.com

Questions?
We'll get back to you
in ONE business day.
Our Locations
THE FOUNDRY [map] LunaMetrics

24 S. 18th Street
Suite 100

Pittsburgh, PA 15203

THE STUDIO [map]

4115 N. Ravenswood
Suite 101
Chicago, IL 60613

THE LODGE [map]

2100 Manchester Rd.
Building C, Suite 1750
Wheaton, IL 60187