Rosenverse
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

Gold
Tuesday, December 6, 2022 • Design in Product 2022
Share the love for this talk
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Speakers: Adam Thomas
Link:

Summary

When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant.

In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them.

Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.

Key Insights

  • •

    60-90% of product ideas do not improve intended metrics, causing waste and burnout.

  • •

    Steve Jobs’ reality distortion field exemplifies pushing forward without feedback, which can lead to failure in today’s environment.

  • •

    Good strategy consists of diagnosis of the problem, a clear guiding policy, and coherent actions aligned to it.

  • •

    Repeated incongruence—continuously reassessing incentives and data—strengthens decision-making muscles vital for pivots.

  • •

    Building trust through recognition, challenge stress, discretion, and vulnerability is key to politically safe change.

  • •

    Moving fast requires limiting options through predefined language and focusing on reversible, coin-flip decisions.

  • •

    Being data-informed means using data to inform decisions, not blindly driving them; ignoring gut and context can be fatal (e.g., Challenger disaster).

  • •

    Sensing metrics are time-bound, contextual, tied to decisions, and linked back to strategy—unlike traditional feature-focused roadmaps.

  • •

    Stopping, pivoting, and investing early are essential decisions teams must iterate on to avoid sunk cost fallacy.

  • •

    A clear story anchored in company culture with a villain (problem) helps communicate strategy and build trust for decision-making.

Notable Quotes

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

"Everyone has a plan until they get punched in the mouth, said Mike Tyson."

"Feature roadmaps are bad because over time coherent actions become noise."

"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."

"Stop, pivot, or invest early—these are the survival metric decisions that save companies."

"Trust is built by recognizing excellence, inducing challenge stress, giving discretion, and showing vulnerability."

"Most decisions are coin flip decisions—easily reversible and should be treated as defaults."

"You have to ask, what are we deciding, and what are we quitting, on a regular basis."

"If you’re not investing or quitting something, what is the point of having a strategy?"

"Repetition, representation, and association are the keys to great theater and great product development."

Ask the Rosenbot
Jeff Sussna
What DesignOps Can Learn From DevOps
2017 • DesignOps Summit 2017
Gold
Gillian Salerno-Rebic
Redefining Speed and Scale: How Accenture’s GrowthOS Uses AI-Simulated Insights to Reduce Risk and Accelerate Innovation
2025 • Designing with AI 2025
Gold
Nathan Shedroff
Redefining Value: Bridging the Innovation Culture Divide
2015 • Enterprise UX 2015
Gold
Patrizia Bertini
Pushing DesignOps’ Influence into New Global Markets
2022 • DesignOps Summit 2022
Gold
Mohammad Hossein Jarrahi
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
2023 • QuantQual Interest Group
Brennan Hartich
Communicating and Establishing DesignOps as a New Function
2018 • DesignOps Summit 2018
Gold
Janelle Estes
UX Research Trends
2021 • Advancing Research Community
Uday Gajendar
From AI to Zeitgeist: Theory as the design antidote to AI hype
2025 • Rosenfeld Community
Christopher Taylor Edwards
Design as a Team Practice, A Practical Guide to Cross-functional Collaboration
2021 • DesignOps Summit 2021
Gold
Molly Fargotstein
Multipurpose Communication & UX Research Marketing
2019 • DesignOps Community
Bria Alexander
Theme Two Intro
2023 • DesignOps Summit 2023
Gold
Erin Hoffman-John
This Game is Never Done: Design Leadership Techniques from the Video Game World
2017 • DesignOps Summit 2017
Gold
John Cutler
Prioritization for designers and product managers (1st of 3 seminars)
2024 • Rosenfeld Community
Chui Chui Tan
Global insights: Embracing international and intercultural research for innovation
2025 • Advancing Research 2025
Gold
Jon White
Unsticking Research for Better Information Flow
2026 • Advancing Research 2026
Gold
Matt Duignan
HITS, Microsoft's internal human insight system: From research library to living body of knowledge
2019 • Advancing Research Community

More Videos

Marc Fonteijn

"Respondents who feel very connected are twice as likely to say they’re making a significant impact."

Marc Fonteijn Ru Butler

Increase your confidence, influence, and impact (through a Professional Community)

December 3, 2024

Dem Gerolemou

"My ideal state would be to sprout like a potato. That explains everything else."

Dem Gerolemou Alexis Oh Neef Rehman

Climate technology fundamentals

May 15, 2024

Daniela Magaña Flores

"We offer a quantitative approach so you can quickly recognize the strengths and weaknesses in a product compared to competitors."

Daniela Magaña Flores Ariane Rahn Jeff Ephraim Bander

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

March 10, 2022

Abbey Smalley

"Target’s internal teams varied in design maturity from totally nonexistent to full design strategy, so we had to meet them where they were."

Abbey Smalley Sylas Souza

Scaling UX Past the Size of Your Team

January 8, 2024

Patrick Commarford

"We never documented our criteria, leaving stakeholders feeling our decisions were mysterious."

Patrick Commarford

Design Staffing for Impact

January 8, 2024

Xenia Adjoubei

"Data sovereignty is about who owns your data, which country’s laws apply, and how vulnerable groups are fairly protected."

Xenia Adjoubei Sean Bruce

Empowering Communities Through the Researcher in Residence Program

March 29, 2023

Craig Villamor

"Dark patterns are UI designs that trick or manipulate users into doing something they wouldn't otherwise do or that go against their or society’s best interests."

Craig Villamor

Design Systems for Ethical Design

January 26, 2023

Jon Fukuda

"Fostering a culture of use and leadership is essential to make these tools part of daily rituals."

Jon Fukuda Ellie Krysl

Design Planning and Management Support

October 3, 2023

Iain McMaster

"Knowing your teammates personally helps in remote settings, especially for encouraging shy or quiet engineers to engage."

Iain McMaster IHan Cheng

Design and Product: from Frenemy to Harmony

November 29, 2023