< Back to main blog page

September 2021: Experimentation News Round Up

Words by: Daniel Molina Last updated: October 7th, 2021 16 min. read

  • Experimentation News

Experimentation News

Decision Making at Netflix

Netflix Technology Blog | By Martin Tingley with Wenjing Zheng, Simon Ejdemyr, Stephanie Lane, and Colin McFarland

“This introduction is the first in a multi-part series on how Netflix uses A/B tests to make decisions that continuously improve our products, so we can deliver more joy and satisfaction to our members.”

Read more

What is an A/B Test?

Netflix Technology Blog | By Martin Tingley with Wenjing Zheng, Simon Ejdemyr, Stephanie Lane, and Colin McFarland

“Experimentation is a cornerstone of agile software delivery. Yet I’ve noticed some confusion over the definition of an experiment and how the process is carried out. Today, we will examine the basic steps, how other professions in science and healthcare address experimentation, common factors, and finally, a quick exercise to bring all the concepts together.”

Read more

The 4 Principles DoorDash Used to Increase Its Logistics Experiment Capacity by 1000%

DoorDash Engineering Blog | By Sifeng Lin and Yixin Tang

“In a data-driven world, being able to run massive numbers of experiments with scientific rigor and accuracy is key to unlocking fast development velocity. At DoorDash we were able to achieve this through the four pillars of our platform.”

Read more

Decision Making through experimentation at Rappi

RappiBank Medium Blog | By David Zarruk

“At Rappi, as in most tech companies, decisions are made with data. Every change, from simple UI changes to algorithm iterations, is implemented to improve user experience or maximize business metrics. Therefore, experimentation is at the core of every decision.”

Read more

A/B testing to improve recommender products

Adevinta Medium Blog | By Elena Moreno, Jose San Pedro and Jordi Esteve

“In this blog post, you’ll read about online experimentation, why it’s key to measure the impact of recommender models on our marketplaces and you’ll know more about the different types of experiments we lead.”

Read more

How Wish A/B tests percentiles

Towards Data Science Blog | By Qike (Max) Li

“In this article, we share our journey of developing an A/B testing methodology for percentiles. You will see the example use cases, why it is challenging to A/B test percentile metrics, how the seemingly simple solutions fail, the statistical test we end up using, and the performance of the test.”

Read more

SPACE10 and IKEA publish latest Everyday Experiments

MobileMarketingMagazine.com | By David Murphy

“A series of digital experiments, Everyday Experiments aims to explore the role of technology in the home and take the everyday and make it extraordinary. Reflecting on people’s time confined indoors, collaborators explored both ways to escape and solve problems at home to make the everyday a little bit better.”

Read more

Will AI Tools Replace Living, Breathing Digital Marketers?

RollingStone.com | By Erik Huberman

“Artificial intelligence (AI) is making a lot of waves in the digital marketing space. Companies testing ads with AI are seeing significant increases in conversions along with equally significant reductions in costs as the cost of running successful ads also drives down the cost per acquisition.”

Read more

Writer in Tech? 7 Reasons You Should Run A/B Tests

UX Collective Blog | By Bar Zuckerman

“An effective tool that helps turn writers into more than just writers, but also masters of product, marketing, and business is content A/B tests. Unfortunately, it’s a tool that isn’t used enough by content professionals. Product professionals for example, never release a feature without experimenting with at least 2 versions. So why is content any different?”

Read more

B2B Customers Expect More Than Ever. Demand Centers Can Help.

Harvard Business Review | By Andris A. Zoltners, PK Sinha, Sally E. Lorimer, and Arun Shastri

“Once companies put a demand center in place, they generally find that lead conversion rates are higher, while lead generation costs are lower. The selling organization is nimbler as customers and markets evolve.”

Read more

New Research: Data And Culture Fuel Innovation

Forbes | By Splunk

“The results are remarkable. We found that leading organizations, the ones with the most mature data practices and explicit markers of an innovation culture, see better results.”

Read more

11 of the Best A/B Testing Tools for 2021

Hubspot Blog | By Clifford Chi

“We’ve curated eight of the best A/B testing tools that’ll help you optimize your website design, copy, product, and, most importantly, help you find the answers tailored to your needs”

Read more

Who’s Hiring?

Various Roles| WiderfunnelVancouver, BC

Principal Analyst, Experimentation| Cars.comChicago, IL

Site Optimization Lead| LogitechNewark, CA

Software Engineering Manager – Experimentation Platform| Sony Interactive Entertainment PlayStationSan Francisco, CA

Senior Data Engineer – Experimentation Platform| Sony Interactive Entertainment PlayStationSan Francisco, CA

Data Engineer – Experimentation Platform| Sony Interactive Entertainment PlayStationSan Francisco, CA

Senior Software Engineer – Experimentation Platform| Sony Interactive Entertainment PlayStationSan Francisco, CA

Software Engineer – Experimentation Platform| Sony Interactive Entertainment PlayStationSan Francisco, CA

Sr. Product Manager, Experimentation Platform| Sony Interactive Entertainment PlayStationSan Francisco, CA

Manager, UX/UI Designer| NRGHouston, TX

Sr. Marketing Manager, Experiments| AmazonSeattle, WA

Senior Product Manager, Experimentation| ZipRecruiterAustin, TX

Director of Product, Experimentation| NikeBeaverton, OR

Experimentation Lead, Web Presence| StripeNew York, NY

Manager, Marketing Experimentation|| TwitterAtlanta, GA

Senior Product Manager, Experimentation| Thomson Reuters Eagan, MN

Senior Data Scientist- Experimentation| Robinhood Menlo Park, CA

Lead, Experimentation| Macy’sNYC, NY

Experimentation Manager, The Roku Channel| Roku IncSan Jose, CA

Senior Manager, Product Optimization| Thomson ReutersEagan, MN

Senior Product Manager- Experimentation| Thomson ReutersEagan, MN

Product Manager, Experimentation| PlutoTVWest Hollywood, CA

Sr. Product Manager, Experimentation| WarnerMediaCulver City, CA

Senior Experimentation Manager | ZillowSeattle, WA

Director, Experimentation | ComcastPhiladelphia, PA

Technical Director – Experimentation| Electronic ArtsRedwood City, CA

Manager, Testing Optimization| LionsgateSanta Monica, CA

Optimization Manager| FenderLos Angeles, CA

Product Manager, Optimization| Delta Air LinesAtlanta, GA

Leader, Digital & Online Analytics| ZoomSan Francisco, CA

Conversion Rate Optimization Manager| PaychexRochester, NY

Sr Director, Growth and Web Strategy| Auth0Dallas, TX (US or Canada Remote)

Subscribe to get experimentation insights straight to your inbox.