In an interesting and timely post entitled Experiment or Die. Five Reasons And Awesome Testing Ideas, Avinash Kaushik declares that “there is a tendency to think experimentation and testing is optional” while he correctly believes that, in reality, that view is fundamentally wrong. Instead, Avinash believes companies’ motto should be “Experiment or die, there is no try.”
As is common on all great blogs, Avinash’s post elicited a lively discussion where the theme of many comments was around the reasons why organizations aren’t wildly embracing testing and optimization as a strategy. We are lucky to work with an amazing group of clients that are completely committed to Conversion Rate Optimization. However, from time to time, especially as we present to public audiences, we do get what we consider to be odd insights from companies that are *considering* testing and need more ammo.
But the basic question remains: why aren’t MORE companies embracing this proven strategy?
Here are some of the reason why I believe testing is a tougher “sell” than it should be:
1. Many marketers (i.e., those making the decision to test-or-not-to-test) don’t want to be measured, pure and simple. And they don’t want to be measure because their compensation and rewards system is not tied to their company’s ROI metrics. So they prefer “hope-driven leaps of faith” to making make data-driven decisions – this way, they cannot “fail”
2. Site owners/marketing directors (where one would assume the compensation/reward system is properly aligned) who don’t embrace this strategy do so likely because the skill sets required to pull Conversion Rate Optimization off as a strategy (and not as a one-off party trick you can brag once) are very varied.
Skills range from experience developing a testing strategy to web wire-framing and design, copy, coding, etc. People with ALL these skills don’t usually (if ever) reside within one company’s marketing department, sitting idle just waiting for a new set of tasks to come their way.
(One reason we think we are in demand is that we provide turnkey experiment services. We address the billable hours problem Avinash talks about in his post through flat rates. This way, no one gets nickel-and-dimed.)
3. Not knowing what to test is a HUGE reason why companies don’t test, or stop after the first test (usually a test of a red button – ok, yes, that one is a no-brainer).
Plus, not knowing what to test, coupled with a powerful tool like GWO, often translates into poorly designed experiments that take months and months to complete. Now, that is off-putting to any marketer with revenue responsibilities.
4. Another reason for lack of adoption has to do with the expected lift in conversions vs. the cost of experimentation. Clearly, in some cases, there isn’t enough traffic and/or margin to support investing in experiments beyond some basic do-it-yourself stuff (i.e., the “six and a half minute experiment” Avinash mentions in his blog).
If you would like to determine whether or not Conversion Rate Optimization is worth it, simply download the calculator here and decide for yourself if this strategy makes sense.
This website uses IntenseDebate comments, but they are not currently loaded because either your browser doesn't support JavaScript, or they didn't load fast enough.
5. Indirect costs and efforts such as producing the creative and copy versions to be tested.
It truly escapes me. Why aren’t more people in Web Marketing getting that testing *is* the ultimate goal? Web Marketing in very close to Direct Marketing in many regards, and those guys will tell you that testing is everything!
Back in 2005, when I worked for Bell, I had the chance to become Offermatica’s Canadian partner. I pitched then not only their solution, but A/B and MVT in general, and could not bring one company to try (OK, I may not be the best salesman in the world).
Three years later, it baffles me to see still how so few companies test online!…
Anyway, thanks to people like you guys, tireless evangelists, there is hope.
Jacques, thank you for the post.
Like you, we have been “in the trenches” for a number of years and are (finally!) actually seeing a healthy adoption rate for Conversion Rate Optimization as a viable strategy. The slowdown in the economy just might have something to do with this…
To address the barrier you identify (”indirect costs and efforts such as producing the creative and copy versions to be tested”), we charge a flat rate per experiment round, this way clients know precisely how much they will pay (the TCO, so to speak) and there are no “surprises”…
A basic hurdle, however, continues to be lack of awareness of testing (in a statistically valid way rather than just “hope-driven tweaks”) as an option to improve conversions.
Name*
Mail* (Will not be published)
Website
Blog-To-Email Approx. 1-2 per week.
Our Conversion Optimization Experts are ready to work with you to measurably improve your business. Call Us Now: 604-569-0897
Download Conversion Rate Optimization whitepapers, ROI calculators, and worksheets. Call Us Now: 604-569-0897