In this blog post, the Disney Streaming team talks about their experience piloting “holdout groups” for Hulu subscribers. Learn more about what a holdout group is, why they needed it and the lessons learned.
Experimentation team at Netflix continues their multi-part series on how Netflix uses A/B testing to inform decisions and innovate. This is Part 3, where they focus on “building intuition” of what a false positive is.
This is part 4 of the multi-part series on A/B Testing by the Netflix experimentation team, focusing on false negatives and statistical power.
In this blog post, Kai Mackie, Product Analyst at Gousto, shares how Behavioral Science plays a role in a/b testing at Gousto. Some real-world examples include leveraging social proof and loss aversion.
Jordi Mas, Engineering Manager at Adevinta, shares his experience with scaling down the team to operate more efficiently, using a data-driven approach. Follow their story on how they took a team of 14 and divided it into smaller teams, leveraging A/B testing to compare results. Adevinta seems to have a very strong culture of experimentation, where they apply the same mindset to overcome their own internal operational challenges.
Many news organizations like the New York Times or The Boston Globe are A/B testing their headlines. So NiemanLab partnered with Chartbeat, an analytics tool that offers A/B testing, to analyze 141,000 headline A/B tests run by 293 news websites. Find out what they learned.
The Chief Product Officer of Optimizely, Justin Anovic, shares his perspective and advice on personalization and experimentation. Includes a story on how AeroMexico was able to personalize their check-out experience to boost conversion rates
Optimizely revealed results from a new survey of 5,000 consumers in the US, UK, Germany, Australia and Sweden. Some of the findings include that, on average, American consumers expect their holiday spending budgets to increase 25% compared to last year. Great news for retailers!
Ecom Growth Optimization Manager| adidas – Portland, OR
Testing & Optimization Analyst (UX Researcher – Quantitative)| Home Depot Canada – Toronto, ON
Design Lead| Widerfunnel – Vancouver, BC
Digital Optimization Strategist| Widerfunnel – Vancouver, BC
Digital Programs Manager| Widerfunnel – Vancouver, BC
Specialist, Digital Optimization| Wiley – Remote, USA
Principal Analyst, Experimentation| Cars.com – Chicago, IL
Senior Product Manager Intuit Experimentation Platform| Intuit – Mountain View, CA
Assistant Manager, Digital Experience Optimization| Adidas – Portland, OR
Site Optimization Lead| Logitech – Newark, CA
Software Engineering Manager – Experimentation Platform| Sony Interactive Entertainment PlayStation – San Francisco, CA
Product Manager – Experimentation & AB Testing| Lowe’s – Charlotte, NC
Manager, UX/UI Designer| NRG – Houston, TX
Senior Data Analyst-Data Science Experimentation| Realtor.com – Phoenix, AZ
Sr. Marketing Manager, Experiments| Amazon – Seattle, WA
Senior Product Manager, Experimentation| ZipRecruiter – Austin, TX
Director of Product, Experimentation| Nike – Beaverton, OR
Director of Experimentation Engineering| Nike – Beaverton, OR
Experimentation Lead, Web Presence| Stripe – New York, NY
Senior Product Manager – Experimentation| Twitter – Remote
Experimentation Advocate| Robinhood – Menlo Park, CA
Lead, Experimentation| Macy’s – NYC, NY
Sr. Product Manager, Experimentation| WarnerMedia – Culver City, CA
Director, Experimentation| Comcast – Philadelphia, PA
Technical Director – Experimentation| Electronic Arts – Redwood City, CA
Manager, Testing Optimization| Lionsgate – Santa Monica, CA
Optimization Manager| Fender – Los Angeles, CA
Subscribe to get experimentation insights straight to your inbox.