< Back to main blog page

August 2021: Experimentation News Round Up

Words by: Daniel Molina Last updated: September 10th, 2021 14 min. read

  • Experimentation News

Experimentation News

Scientific Approach to Testing Ideas Helps Startups Fail and Scale Faster

Duke Fuqua Blog | By Duke Fuqua Staff

“Sharique Hasan and Aaron ‘Ronnie’ Chatterji, both strategy professors at Duke University’s Fuqua School of Business, studied more than 35,000 high-tech startups founded between 2008 and 2013. The researchers found startups that use a series of randomized controlled trials to test options for product features – otherwise known as A/B testing – are more successful, on average, than startups that don’t follow this type of data-driven approach.”

Read more

What Does Experimentation Mean In Agile Software Delivery?

Agile Insider | By Lisa Bradburn

“Experimentation is a cornerstone of agile software delivery. Yet I’ve noticed some confusion over the definition of an experiment and how the process is carried out. Today, we will examine the basic steps, how other professions in science and healthcare address experimentation, common factors, and finally, a quick exercise to bring all the concepts together.”

Read more

Can companies build on their digital surge?

McKinsey.com | By Arun Arora, Daniel Glaser, Nicolas Jabs, and Tom Youldon

“While top economic performers are already significantly ahead of their peers in specific digital capabilities (automation, for example), they are also moving much more quickly than their peers in key business areas. Top tech companies, for example, share test-and-learn findings across the business, reallocate digital talent, and use multiple sources of insight about customers weekly, while average performers do those tasks monthly.”

Read more

Getting strategic about your A/B tests. My experience to developing experimentation portfolio

Medium.com | By Rina Fufaeva

I first wanted to share some thoughts on why this approach works and why we are so focused on experimentation velocity. HelloFresh is a company with users counting in millions and high user traffic, so we get a lot of data quickly, allowing experiments to reach statistical significance in a matter of weeks and in some cases, days. That drives the cost of a single experiment down and makes it financially justifiable to experiment often.

Read more

A/B Testing Starter Guide — Software Engineering Perspective

Medium.com | By Mohamed Adel

In this era of internet of things, business development and optimization remarkably lies in the power of learning and adapting, in which A/B testing is essentially the core. We use A/B test to analyze and understand how things perform against a controlled baseline. A decent years back, A/B tests were metaphorically referred as oil or fuel of the future, and more recently the comparison has been with sunlight because like solar rays, they will be everywhere and underlie everything.

Read more

The A/B testing culture — a guide about how to design successful online controlled experiments (1/3)

Medium.com | By Claudia Chitu

“I have been writing this article based on and after reading the book: “Trustworthy online controlled experiments — A practical guide to A/B testing”, by Kohavi, Tang and Xu, probably the most helpful business AND technical book. The motivation is to share the beautiful story of how science plays a vital role in business today more than ever and encourage product owners to get closer to engineers so that they have fun while building successful growth for their organizations.”p>
Read more

Do Your Digital Design Choices Take Advantage of Customers?

Harvard Business Review | By Michael Luca and Fiona Scott Morton

“Executives must play a proactive role in making sure their digital design functions in the best interests of users. Doing so has the potential to give companies a deeper and more positive relationship with its customers. Brands that design their sites to exploit consumer behavioral bias (or those that fail to recognize that they do so unknowingly) might benefit in the short term, but the damage done to their reputation will do lasting harm.”

Read more

Who’s Hiring?

Various Roles| WiderfunnelVancouver, BC

Site Optimization Lead| LogitechNewark, CA

Software Engineering Manager – Experimentation Platform| Sony Interactive Entertainment PlayStationSan Francisco, CA

Senior Data Engineer – Experimentation Platform| Sony Interactive Entertainment PlayStationSan Francisco, CA

Data Engineer – Experimentation Platform| Sony Interactive Entertainment PlayStationSan Francisco, CA

Senior Software Engineer – Experimentation Platform| Sony Interactive Entertainment PlayStationSan Francisco, CA

Software Engineer – Experimentation Platform| Sony Interactive Entertainment PlayStationSan Francisco, CA

Sr. Product Manager, Experimentation Platform| Sony Interactive Entertainment PlayStationSan Francisco, CA

Manager, UX/UI Designer| NRGHouston, TX

Sr. Marketing Manager, Experiments| AmazonSeattle, WA

Experimentation Advocate| SplitRemote

Senior Product Manager, Experimentation| ZipRecruiterAustin, TX

Director of Product, Experimentation| NikeBeaverton, OR

Experimentation Lead, Web Presence| StripeNew York, NY

Manager, Marketing Experimentation|| TwitterAtlanta, GA

Senior Product Manager, Experimentation| Thomson Reuters Eagan, MN

Senior Data Scientist- Experimentation| Robinhood Menlo Park, CA

Lead, Experimentation| Macy’sNYC, NY

Experimentation Manager, The Roku Channel| Roku IncSan Jose, CA

Senior Manager, Product Optimization| Thomson ReutersEagan, MN

Senior Product Manager- Experimentation| Thomson ReutersEagan, MN

Product Manager, Experimentation| PlutoTVWest Hollywood, CA

Sr. Product Manager, Experimentation| WarnerMediaCulver City, CA

Senior Experimentation Manager | ZillowSeattle, WA

Sr. Director, Product Management (Experimentation)| Discovery IncNew York, NY

Director, Experimentation | ComcastPhiladelphia, PA

Experimentation Program Manager | HPVancouver, WA

Manager, Data Science – Experimentation| Hyatt HotelsChicago, IL

UX Researcher, Editorial Experimentation| McClatchyWashington, DC

Technical Director – Experimentation| Electronic ArtsRedwood City, CA

Sr. Analyst, Retail Experimentation| Canadian TireOntario, Canada

Manager, Testing Optimization| LionsgateSanta Monica, CA

Optimization Manager| FenderLos Angeles, CA

Product Manager, Optimization| Delta Air LinesAtlanta, GA

Subscribe to get experimentation insights straight to your inbox.