Using data available publicly through the website BuiltWith, researchers identified companies that were up to eight years old that had installed A/B testing software, and studied firm performance before and after testing began.
The earlier that customer insight can be brought into the process, the more their feedback can be used to experiment and inform the end product.
Companies that want to compete need to empower their developers and adopt a “software mindset”: Assign problems to your team, rather than tasks; run a lot of experiments — and tolerate failures; become obsessed with speed; and keep your developers close to your customers.
If you are part of a company that intentionally “places bets” for strategic initiatives, then the ability to make smarter decisions is imperative to potential success. Controlled business experiments enable you to test your bets, by leveraging data scientists and being ever more data literate.
From the archives (2018)
While transformation may come from the top, employees with a flexible approach to experimentation may be what’s needed to make it happen.
Events and Webinars
Past webinars / events:
Brandon Maskell, Optimization leader at TaylorMade, discusses how you can design a rigorous customer experience optimization program.
Beth Foster, the leader of the Microsoft Digital Stores Experimentation team, shares the approaches she has taken to build a culture of experimentation, as well as her successes and failures along the way.
Senior Manager, Demand Generation| Cohesity – San Francisco, CA
Experimentation Strategist| Fanatics. Inc – San Mateo, CA
Connected Marketplace Optimization Insights Manager| Nike – Beaverton, CA
Lead, Experimentation| Macy’s – NYC, NY
Product Manager, Experimentation| Lyft – San Francisco, CA
Senior Manager, Experimentation| Realtor.com – Santa Clara, CA
Data Analyst, Experimentation Platform| New York Times – NYC, NY
Product Manager: Experimentation and Logging A/B Testing| Ford Motor Company – Dearborn, MI
Senior Product Manager, A/B Testing| Levi Strauss & Co. – San Francisco, CA
Senior Manager, Conversion Optimization| Homer – NYC, NY
Manager, Conversion Rate Optimization (CRO)| Root – Remote, USA
Director Conversion Rate Optimization-Remote| Pearson – Queens, NY
Director, Experimentation Platform and Sciences| Etsy – Brooklyn, NY
Sr. Data Scientist – Experimentation| McAfee – San Jose, CA
Director of Experimentation, Growth| Gympass – New York City, NY
Senior Manager, A/B Testing| Realtor.com – Santa Clara, CA
Experimentation Program Manager – Growth Marketing| Malwarebytes – Clearwater, FL
Senior Support Planner for Experimentation| Microsoft – Irving, TX
Product Manager| Epic Games – Cary, NC
Head of Advertising Experimentation, Analytics and Insights| Amazon – NYC, NY
VP, Growth Marketing| MongoDB – NYC, NY
Located in Canada
Conversion Rate Optimization Manager| Galvanize – Vancouver, BC
Director of Experimentation| KOHO – Remote, Canada
CRO Manager| Buyerlink – Toronto,ON
Conversion Rate Optimization Manager| Docebo – Toronto,ON
CRO Manager| Quark Expeditions – Toronto,ON