Upcoming LunaMetrics Seminars
Pittsburgh, Jan 12-16 Boston, Jan 12-16 New York City, Jan 26-30 Denver, Feb 9-13

What do web analysts do all day long?

I hear this question a lot. What do we web analysts do with our time? To make this tractable, I am going to focus just on web analytics – no split path testing, no data mining, no user testing, no… no.. just what one considers to be “traditional” web analytics. (Maybe an oxymoron?)

I think web analysis has four goals:

1. We use web analytics to troubleshoot the site and the business

Is a conversion rate down significantly, are page views/visitor way off? Is some other performance metric not performing? If so, where is the problem coming from — from a certain section of the site, from a certain product? Is that page or piece of the site broken in some way – code missing, a link not working? If the site is not broken, is the problem coming from traffic sources – an AdWords campaign that is landing in the wrong place, a referrer that no longer refers, an affiliate you forgot to pay and so conveniently forgets to send you traffic? Notice how I went from the most general information, such as conversion rate or page views, down to specific information, such as whether an affiliate is angry at us.

And if nothing is broken — how can we account for the problem? Is the metric down across all sources and all products? Is it down vs. last year (or are we just seeing seasonality?) Is there new competition, or better competition (and with that, I have to leave off, since I promised to limit this to web analytics.)

Don’t be fooled into thinking that there is no ROI here. When you find a problem and fix it quickly, you avoid days worth of opportunity loss — revenue that might have been left on the table or leads that registered with a competitor, were it not for you, the analyst.

2. We use web analytics to figure out how to make the site better.

This one is an all-nighter topic, and it is midnight already. So here are some easy examples. We might compare the conversion funnel from Lead Form 1 and see it converting from the form itself to the Thank You (success) page at 25%, yet the conversion funnel from Lead Form 2 converts at only 12.5% — so what are the differences in design? We might just look at bounce rates (single entry rates) and compare similar pages that bounce at very different rates. We look at our successful keywords in our Finding Methods report to figure out how to optimize our site for those, since those are clearly some of the ways that customers are using to search for our site. We look at conversion rate by source to decide which paid campaigns to pour more money into and which to cut. We segment our customers all the way down until we figure out what the most profitable customer looks like and where she comes from, and then we pour more resources into finding more customers just like her.

This is the area that gets the most attention from top management (unless the site is broken, in which case, they are furious.)

3. We spend time making our web analytics perform better.

Software isn’t perfect, but if we are going to invest in it (and even if it’s free, our time is an investement), then let’s get the most out of it. To use the form example from the point above – if our software supports it, we can track each spot in the form and see where potential leads bail. Better analytics can help us do a better job of spotting online opportunities. We also fix our web analytics when they break — because, why would you invest in a $50K/year package (not to mention the analyst you have to pay), to have broken analytics and learn nothing? Technically, this third goal is just a way to achieve #1 and #2, but we (I?) spend enough time at it that it was hard not to call this one out.

4. We present the information to management in a format that makes them care about the information and take action.

This is perhaps our hardest job. We get down so deep in the data that it is hard to remember the needs of management (or customers.) They have other things to do so if the analysis doesn’t come to them in a meaningful and easy format, they stop caring. I should also point out how important consistency is. Once your CEO or customer understands the metrics, you can improve upon them gradually, but don’t change the format (or heaven forbid, the metrics) arbitrarily.

I will be using some of this at the Summit, so please comment and criticize!

Robbin Steif
LunaMetrics

Robbin Steif

About Robbin Steif

Our owner and CEO, Robbin Steif, started LunaMetrics ten years ago. She is a graduate of Harvard College and the Harvard Business School, and has served on the Board of Directors for the Digital Analytics Association. Robbin is a recent winner of a BusinessWomen First award, as well as a Diamond Award for business leadership.

http://www.lunametrics.com/blog/2006/09/07/what-do-web-analysts-do-all-day-long/

8 Responses to “What do web analysts do all day long?”

Clint says:

Robbin,
what about the investment in learning?

A not insignificant amount of my time (and yes, some of that is during the day) is spent learning about what others are doing and what’s going on the industry so that I can improve what we’re doing.

Spending too much time in your own silo can be deadly.

Lars says:

I’ll just show that list when my boss is wondering what the heck I’m doing. ;-) Just kidding. Good list though, and good point by Clint.

But why no data mining etc?

Ach, I wrote a whole comment and lost it.

Lars – I limited the scope so that I wouldn’t go to be ridiculously late, just very late.

Clint – a great point, but not a goal – we don’t learn for learning’s sake, on the job, we learn so that we can make more money with the site, present better, etc. Clint’s excellent visualization blog, Instant Cognition, is must reading for #4, presentation (I was his first subscriber). Another great visualization blog is Juice Analytics. I meant to include both last night but just didn’t have one more minute of no-sleep in me.

Lars, that was about going to BED too late. (See what no sleep does to you?)
Robbin

Pratt says:

Finally I understand what you are doing while I’m hard at work!! Just kidding ;)

Great post.

Jim Humphrys says:

Hi Robbin,
This is a good post. Well done.

Somewhere between “trouble shooting the site, business” and “making the site better”, you might want to add evaluating on-line campaigns. The reach of a web analyst goes beyond the limits of their web site or the web team.

Also, I spend a fair amount of time educating others. It isn’t just “upward” to “management”. (Your comment about “customer” can be stretched to cover anyone who uses your metrics, so you do cover this in point 4.) This is probably my biggest job. Part of the education is around “what is possible”, part is around “why measure”, and part is around “how to measure”. This is necessary in part to drive metrics adoption.

Food for thought.
Jim

Justin Cutroni says:

Hey Robbin,

I love this post! One thing I would add is we (hopefully) change people’s perception re: how they do business online. I work with many clients that are completely new to the web analytics space. It takes a lot of effort to get them into a continuous improvement process. I hate the term, but it is a paradigm shift for many people.

Jusitn

Hmm, I was thinking that maybe your point, Justin, was more specific to those of us in consulting, but then again — think of all those analysts who have to persuade their bosses to create customized landing pages, to get the conversion opportunity above the fold, to write for the customer. I do think this is part of my last point, present so that they get it, but you point out that the presentation is not just a ppt but really, an education. And Jim Humphrys said the same thing in a different way. Not just food for thought; a veritable feast. Or at least, a high calorie shake.