Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Summary
When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant. In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them. Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.
Key Insights
-
•
60-90% of product ideas do not improve intended metrics, causing waste and burnout.
-
•
Steve Jobs’ reality distortion field exemplifies pushing forward without feedback, which can lead to failure in today’s environment.
-
•
Good strategy consists of diagnosis of the problem, a clear guiding policy, and coherent actions aligned to it.
-
•
Repeated incongruence—continuously reassessing incentives and data—strengthens decision-making muscles vital for pivots.
-
•
Building trust through recognition, challenge stress, discretion, and vulnerability is key to politically safe change.
-
•
Moving fast requires limiting options through predefined language and focusing on reversible, coin-flip decisions.
-
•
Being data-informed means using data to inform decisions, not blindly driving them; ignoring gut and context can be fatal (e.g., Challenger disaster).
-
•
Sensing metrics are time-bound, contextual, tied to decisions, and linked back to strategy—unlike traditional feature-focused roadmaps.
-
•
Stopping, pivoting, and investing early are essential decisions teams must iterate on to avoid sunk cost fallacy.
-
•
A clear story anchored in company culture with a villain (problem) helps communicate strategy and build trust for decision-making.
Notable Quotes
"60 to 90% of our ideas do not improve the metrics they were intended to improve."
"Everyone has a plan until they get punched in the mouth, said Mike Tyson."
"Feature roadmaps are bad because over time coherent actions become noise."
"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."
"Stop, pivot, or invest early—these are the survival metric decisions that save companies."
"Trust is built by recognizing excellence, inducing challenge stress, giving discretion, and showing vulnerability."
"Most decisions are coin flip decisions—easily reversible and should be treated as defaults."
"You have to ask, what are we deciding, and what are we quitting, on a regular basis."
"If you’re not investing or quitting something, what is the point of having a strategy?"
"Repetition, representation, and association are the keys to great theater and great product development."
Or choose a question:
More Videos
"Jazz soloists draw from a lifetime of patterns, sometimes quoting TV theme songs like the Muppets or Sanford and Son."
Jim KalbachJazz Improvisation as a Model for Team Collaboration
November 6, 2017
"You want someone who writes with equal parts empathy and authority, not just pure authority."
Louis RosenfeldCoffee with Lou: Should You Write a (UX) Book?
March 7, 2024
"If you’re sitting there thinking I need to build out this project and nobody else is saying the same thing, it means you have to do it, period."
Catt Small Micah Bennett Brian Carr Jessica HarlleeWhat's Next for ICs: Exploring Staff and Principal Designer Roles
February 22, 2024
"Sharing your research skills broadly within your company can create unexpected opportunities to improve experiences."
Marieke McCloskeyUser Science: Product Analytics & User Research
March 11, 2021
"Wonder Studio automatically segments actors, maps their movements to a 3D model, and renders a synthetic avatar video."
Llewyn Paine[Demo] Deploying AI doppelgangers to de-identify user research recordings
June 5, 2024
"You don’t want to overdesign just to make something more data interpretable because that can lead you down a dark path."
Joshua NobleCasual Inference
October 6, 2023
"We’re selectively skeptical—skeptical about some things but not others based on what we want to believe."
Sara LogelYour Colleagues are Your Users Too
March 29, 2023
"Learning is a marathon, not a sprint, especially in the context of online conferences."
Bria Alexander Louis RosenfeldWelcome
January 8, 2024
"Confidence is a higher burden in retail because people are giving real money; inaccessible flows cause quick abandonment."
Sam ProulxOnline Shopping: Designing an Accessible Experience
June 7, 2023
