Great…simply great, pre-survey is definitely help for result for the best. I think survey made people more knowledgeable about the product.

Our site gets about 9000 visits/week, only about 3/10 of the visits get served the opportunity to comment, I get a comment about once every other week. So that’s one Kampyle “conversion” out of about 5400 opportunities, or a conversion rate of .018%. So to get just a few hundred (let’s say 500), you would need to show your 4Q survey to 2.7M visits. Since you tell people to err on the side of caution wrt sampling rate, maybe they show it to one out of four people. So now you need 10.8 million visits/month to get a few hundred (assuming the same conversion rate I have.)

Those are a lot of assumptions and you are welcome to tell me how wrong I am.

Bjoern, that is such an interesting way of looking at it. I wish I could remember the name of the scientific principle.

Mike, do you think that if we only put it on the thank you page, we skew our results to people who were satisfied enough to buy or give us their name? My guess is that we skew it, but still get some valuable data. Maybe you will tell us what you have learned, if you have?

Great point & congrats on giving your users what they want, not what you want!

I think those survey questions can give valuable insight – but I believe the absolute best place to use them is on the thank you page – no sooner.

excellent arguments, in my opninio. We were thinking about employing this kind of feedback mechanism in our subscription shop to get a better qualified idea why people go there without making a purchase. But as your post shows, it’s just like in quantum physics: The observation itself changes the behaviour

You make some very good points there. When we give sampling guidance to our 4Q online survey users, we generally recommend that they err on the side of caution when setting a sampling rate. The great thing about simple random sampling is that you don’t really need a super-sized sample to be able to make accurate generalizations about your visitor population. Often a few hundred a month will do the trick.

We also recommend that our 4Q survey users avoid intercepting visitors during a traffic acquisition or usability testing phase. Experience has shown that the average usability tester is a far more fastidious individual than the average website visitor. That’s not to say that garden-variety survey respondents never express frustration about being intercepted. It does happen, but we’ve seen time and again that the value of the feedback garnered more than makes up for it.

Hoping this adds to the conversation,

Michael Whitehouse
Senior Marketing Analyst
iPerceptions