Experimentation News
How We Reimagined A/B Testing at Squarespace
In this blog post, learn about the tooling and culture improvements Squarespace made and as a result how A/B testing at Squarespace became faster, more accurate, and more impactful.
8 Common Pitfalls of Running A/B Tests
In this post, Leihua Ye lists 8 common pitfalls that industry folks frequently make and how to address each scenario.
Running Experiments with Google Adwords for Campaign Optimization
In this post, Doordash explains how they were able to run an experiment using the Google Adwords Testing Platform: “Experimentation for digital marketing is all about figuring out the most efficient and effective ways to run marketing campaigns on a digital channel.”
Experimentation Weapon of Choice Online, Says New Republique Report
The Pulse Report 2020 is based on the results of the Australian Experimentation Maturity Index and includes feedback from those responsible for digital within some of Australia’s most well-known brands across retail, finance, automotive, travel, and health including Chemist Warehouse, Subaru, P&O, HCF and Fantastic Furniture.
A/B Testing: A Complete Guide to Statistical Testing
In this article, Francesco explains how different statistical methods can be used to make A/B testing successful.
Growth experimentation: why is 2021 the year to become an experiment business?
“Continual learning has always meant continual research, but today’s world is shifting at such a pace that it’s time to go beyond Conversion Optimisation (CRO) and look at addressing some big business questions through experimentation.”
From the archives (2017)
While it’s an often-used method, there are several mistakes that managers make when doing A/B testing: reacting to early data without letting the test run its full course; looking at too many metrics instead of focusing on the ones they most care about; and not doing enough retesting to be sure they didn’t get false positive results.
Who’s Hiring
Program Manager, Experimentation| Microsoft – Redmond, WA
Growth Manager – Experimentation| Samsara – San Francisco, CA
Principal Engineer| Convoy – Seattle, WA
Experimentation Strategist| Fanatics. Inc – San Mateo, CA
Testing and Experience Manager | Nike Direct Digital Commerce – Beaverton, CA
Lead, Experimentation| Macy’s – NYC, NY
Product Manager: Experimentation and Logging A/B Testing| Ford Motor Company – Dearborn, MI
Senior Manager, Conversion Optimization| Homer – NYC, NY
Manager, Conversion Rate Optimization (CRO)| Root – Remote, USA
Manager, Data Science, Experimentation| Etsy – Brooklyn, NY
Sr. Data Scientist – Experimentation| McAfee – San Jose, CA
Director, Experimentation| Realtor.com – Santa Clara, CA
Consumer Product Manager, Experimentation –| Malwarebytes – Clearwater, FL
Product Marketing Manager, Office 365 Subscriber Growth | Microsoft – Redmond, WA
Product Marketing Manager, New Product Experimentation| Facebook – San Francisco, CA
Experimentation Manager, Marketing Technology| Square – Washington, DC
Product Manager| Epic Games – Cary, NC
Data Science Manager- Experimentation, Analytics, and Insights| Amazon – NYC, NY
Senior Product Marketing Manager, Carrier Engagement and Growth| Convoy – Seattle, WA
Data Scientist – Experimentation platform| GoDaddy – Kirkland, WA
Growth Marketing & Conversion Rate Optimization, Manager| Yelp – Remote
Product Manager, Growth (Marketing Optimization)| Robinhood – NYC, NY
Data Science – Experimentation| The Knot Worldwide – Washington, DC
Analytics & Science Manager, Embedded Experimentation| Pinterest – Seattle, WA
Data Science Engineer, Experimentation| Stripe – San Francisco, CA
Principal Data Scientist, Experimentation| HelloFresh – NYC, NY
Conversion Rate Optimization Analyst| Skechers – Manhattan Beach, CA
Located in Canada
Digital Optimization Strategist| Widerfunnel – Vancouver, BC
Director, Experimentation| Realtor.com – Vancouver, BC
Director of Experimentation| KOHO – Remote, Canada
Senior Data Scientist – Experimentation| McAfee – Waterloo, ON
Web Experimentation Specialist| Hootsuite – Vancouver, BC
Conversion Rate Optimization Manager| Docebo – Toronto,ON
Subscribe to get experimentation insights straight to your inbox.