Product Managers develop hypotheses on an almost daily basis. It’s a critical part of the job.
In this episode, we have a great conversation lined up! My guest is Ronny Kohavi, Vice President and Technical Fellow for Relevance and Personalization at Airbnb.
Building an experimentation culture at your organization is similar to creating and sticking to a good habit. Learn how to apply those lessons.
A/B testing is, at this point, widespread and common practice. But even if we all agree on the value of experimentation, there’s a ton of debate and open questions as to how to run A/B tests.
Those who don’t embrace failure, Bezos said, will “eventually get in a desperate position where the only thing they can do is a Hail Mary bet at the very end.”
Wherever there’s a positive change in an organization, you will find a champion leading. I believe 2020 will be remembered as the year of accelerated change.
Despite our best efforts, HiPPOs are key stakeholders that can make or break an optimization program. I recently spoke to Bithika about her thoughts on how to get HiPPOs on our side.
When testing consumer-facing features, we encountered two major challenges that constrained the number of experiments we were able to run per quarter, slowing the development and release of new product features.
[Successful companies] are also more likely than others to report speeding up the time it takes for leaders to receive critical business information and reallocating resources to fund new initiatives. Both are key aspects of a culture of experimentation.
How can retail stores survive online disruption and a pandemic? Start with focusing on the customer experience and creating good loyalty programs.
45 percent of airlines said they do not have a budget for digital optimization and experimentation and 49 percent of airlines do not run experiments at all or only do them on an ad-hoc, project basis.
COVID caused trial and experimentation and if you give people an easy experience, like we do, they tend to come back and we’ve seen that.
The majority of marketers who prioritize testing and experimentation significantly outperform their peers.
Brands can use a ‘test and learn’ approach as a guiding principle to secure their position in today’s reimagined world of business.
“One of the first things that I did when we embarked on this digital transformation was to ensure that we were sticking to our principles of experimentation” she added. “Sometimes that has to be done by edict.”
The shifts brought about by the digital age calls for experimentation, but employees won’t feel enabled to experiment on the job unless they feel safe to fail.
It’s important to me that our team stays culturally curious to their surroundings–in and out of work–and provide room to test out new ideas. I try to keep the process of experimentation joyful; celebrating epic losses and much as big wins to make sure the team feels safe to take risks.
We recommend that companies strive for a test-and-learn environment that supports hypothesis-driven experimentation with a rapid turnaround.
Retailers must employ a strategy that is differentiated, supported by an agile technology platform that allows them to easily experiment, fail cheap, and measure results accurately.
“Before people were afraid to ask but now there’s a spirit of openness and asking ‘what if?’. There are more experimental projects going on that retailers can do in a few weeks and a few thousand pounds into rather than investing in multimillion-pound projects.”
One of the best ways to know if your marketing is working is by running experiments. These experiments offer marketers a clearer understanding of what’s performing well and what can be improved.
The Vision 2021 report shows that organizations admit that they still have a way to go on these low-cost-of-entry tools: only 34% are currently using A/B testing, and a mere 12% are employing personalized web pages.
In this post, we discuss how you can leverage A/B testing on your WordPress site and how it could be a game-changer for your business.
Events and Webinars
Past webinars / events:
Beth Foster, the leader of the Microsoft Digital Stores Experimentation team, shares the approaches she has taken to build a culture of experimentation, as well as her successes and failures along the way.
Find out how you can create an agile, digital-first, customer-obsessed program that drives both product innovation and optimization.
Senior Product Manager, Growth| Change.org – San Francisco, CA
Intuit| Principal Product Manager, Intuit Experimentation Platform (IXP) – San Diego, CA
Senior Product Manager – Growth| Acorns – Irvine, CA
Senior Manager, A/B Testing| Realtor.com – Santa Clara, CA
VP of Product Innovation, Growth| Netflix – Los Gatos, CA
Product Manager, Experimentation and Release| Waymo – Mountain View, CA
Advanced Analytics Manager 3 – Associate Director, Experimentation| Walmart – San Mateo, CA
Engineering Manager, Experimentation| Uber – San Francisco, CA
Product Manager – Experimentation| Lyft – San Francisco, CA}
Product Manager, Growth| Pinterest – San Francisco, CA
Associate Director, Digital Experimentation & Optimization – Neuroscience| Takeda – Boston, MA
A/B Testing – Product Manager| Carter’s – Atlanta, GA
Senior Support Planner for Experimentation| Microsoft – Irving, TX
Lead, Digital A B Testing| Frontier Communications – Irving, TX
Senior Data Scientist – Experimentation| Udemy – Austin, TX
Digital Marketing Manager – Conversion Rate Optimization| Gartner – Austin, TX
Webex – Data and Experimentation Technical Leader| Cisco – Seattle, WA
Director, Growth & Experimentation| Campaign Monitor – Remote, US
Experimentation Strategist| Widerfunnel – Vancouver, BC
Sr Manager, A/B Testing (Experimentation)| Grubhub – Chicago, IL
Conversion Rate Optimization Manager| Evo – Remote, US
Director of Marketing, Conversion| Zazzle – Fort Collins, CO
Product Manager| Epic Games – Cary, NC
Manager, Data Science Experimentation| Disney Streaming Services – NYC, NY
Head of Advertising Experimentation, Analytics and Insights| Amazon – NYC, NY
Product Manager (E-Comm)| HBO Max – NYC, NY
Senior Manager, Conversion Rate Optimization| 2U – Brooklyn, NY
Product Lead, Subscriber Growth Platforms| New York Times – NYC, NY
VP, Growth Marketing| MongoDB – NYC, NY
Senior Mgr, Marketing Operations (Experimentation Execution Framework)| Disney Streaming Services – NYC, NY
Director, Product Experimentation & Testing, Peacock| NBCUniversal – NYC, NY
Director, Experimentation Platform and Sciences| Etsy – Brooklyn, NY
Director of Experimentation, Growth| Gympass – New York City, NY