Rosenverse
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

Gold
Tuesday, December 6, 2022 • Design in Product 2022
Share the love for this talk
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Speakers: Adam Thomas
Link:

Summary

When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant. In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them. Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.

Key Insights

  • 60-90% of product ideas do not improve intended metrics, causing waste and burnout.

  • Steve Jobs’ reality distortion field exemplifies pushing forward without feedback, which can lead to failure in today’s environment.

  • Good strategy consists of diagnosis of the problem, a clear guiding policy, and coherent actions aligned to it.

  • Repeated incongruence—continuously reassessing incentives and data—strengthens decision-making muscles vital for pivots.

  • Building trust through recognition, challenge stress, discretion, and vulnerability is key to politically safe change.

  • Moving fast requires limiting options through predefined language and focusing on reversible, coin-flip decisions.

  • Being data-informed means using data to inform decisions, not blindly driving them; ignoring gut and context can be fatal (e.g., Challenger disaster).

  • Sensing metrics are time-bound, contextual, tied to decisions, and linked back to strategy—unlike traditional feature-focused roadmaps.

  • Stopping, pivoting, and investing early are essential decisions teams must iterate on to avoid sunk cost fallacy.

  • A clear story anchored in company culture with a villain (problem) helps communicate strategy and build trust for decision-making.

Notable Quotes

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

"Everyone has a plan until they get punched in the mouth, said Mike Tyson."

"Feature roadmaps are bad because over time coherent actions become noise."

"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."

"Stop, pivot, or invest early—these are the survival metric decisions that save companies."

"Trust is built by recognizing excellence, inducing challenge stress, giving discretion, and showing vulnerability."

"Most decisions are coin flip decisions—easily reversible and should be treated as defaults."

"You have to ask, what are we deciding, and what are we quitting, on a regular basis."

"If you’re not investing or quitting something, what is the point of having a strategy?"

"Repetition, representation, and association are the keys to great theater and great product development."

Ask the Rosenbot
Kristin Skinner
Theme 2: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
Sharbani Dhar
Breathing Room for Delight
2024 • Enterprise Experience 2020
Gold
Kim Lenox
Leading Distributed Global Teams
2019 • Enterprise Community
Catherine Courage
The Enterprise UX Journey: Lessons From the Voyage & The Opportunity Ahead
2015 • Enterprise UX 2015
Gold
John Maeda
About Design Organizations
2019 • DesignOps Community
Jaime Creixems
Best Practices when Creating and Maintaining a Design System
2023 • Enterprise UX 2023
Gold
Jess Greco
Creating a Basis for Change: Scaling Design Maturity
2022 • Design at Scale 2022
Gold
Dana Chisnell
The Sensemaking Business
2026 • Advancing Research 2026
Gold
Jamika Burge
Embracing change: Navigating shifting landscapes with compassion and agency
2025 • Advancing Research 2025
Gold
Irina Tikhonova
Small Wins, Big Impact: Leveraging and Elevating User Engagement
2021 • Civic Design 2021
Gold
Jim Kalbach
Jazz Improvisation as a Model for Team Collaboration
2017 • DesignOps Summit 2017
Gold
Suzan Bednarz
AccessibilityOps for All
2024 • DesignOps Summit 2020
Gold
Fatimah Richmond
The Future of ReOps as a Strategic Function: A Roadmap for Getting There
2024 • Advancing Research 2024
Gold
Billy Carlson
Tips to Utilize Wireframes to Tell an Effective Product Story
2023 • Enterprise UX 2023
Gold
Kim Holt
A Salesforce Panel Discussion on Values-Driven DesignOps
2022 • DesignOps Summit 2022
Gold
Louis Rosenfeld
Opening Remarks
2022 • Civic Design 2022
Gold

More Videos

Nick Cochran

"Working in Enterprise can feel like chaos."

Nick Cochran

Growing in Enterprise Design through Making Connections

June 20, 2019

Amber Knabl

"It’s way more cost effective to catch accessibility issues during the design phase than after shipping a product."

Amber Knabl

Empowering innovation: The critical role of inclusive product development in the AI era

June 4, 2024

Nora Tejeda

"Design purists weren’t happy about helping developers ‘do design’, but we realized they would do it anyway, so we helped them do it better."

Nora Tejeda Giovanna Alonso

Scaling Design Capabilities at BBVA Through a Self-service Design Model

June 10, 2021

Nathan Shedroff

"Innovation in large companies often requires breaking rules and hiding what you’re doing from management."

Nathan Shedroff

Redefining Value: Bridging the Innovation Culture Divide

May 14, 2015

Lona Moore

"I like to think of myself as a DJ at a party, amplifying the power of design so more people can dance to the future."

Lona Moore

Scaling Design Beyond Designers

June 11, 2021

Jemma Ahmed

"By bringing truth to power is how we bring excellence to our craft and define our value."

Jemma Ahmed

Theme 2 Intro

March 26, 2024

Sabrina Mach

"Design systems act as a single source of truth facilitating collaboration among design and technology."

Sabrina Mach Nina Wainwright

How to Design Your Design Operating Model

September 29, 2021

Kevin M. Hoffman

"Having a business background is almost the oldest form of product management, but great product requires balancing design and tech too."

Kevin M. Hoffman

Theme 2: Enterprise Team Journey

June 3, 2019

Bria Alexander

"We made a very intentional choice to build in five minute breaks after every talk based on feedback and experience."

Bria Alexander Louis Rosenfeld

Welcome

January 8, 2024