Who does what by how much?
Summary
More than ever, we’re tasked with building ways for humans to interact more efficiently with one another, with services, with machines, and now with AI. As the toolset grows as quickly as the challenges we need to solve, how do we know we’re building the right things in the most valuable way? In this practical talk, Jeff will bring together the world of product and service design to focus on the humans in the mix and how to ensure that everything we create has a meaningful, positive impact on them.
Key Insights
-
•
The core value equation in designing services is who does what by how much, focusing on measurable changes in human behavior as outcomes.
-
•
Historically, learning loops to validate product value took 6-12 months, but modern digital services like Amazon enable deployment every second, allowing rapid feedback.
-
•
Managing towards output—the delivery of products or features—often undermines true customer value and slows organizational agility.
-
•
Effective OKRs focus on qualitative objectives describing the desired future customer state without prescribing solutions or features.
-
•
Key results must be outcome-based metrics measuring actual behavior change rather than output milestones.
-
•
All teams, including HR, finance, and legal, can and should use outcome-driven OKRs by focusing on how their outputs change human behavior.
-
•
Product discovery processes like design thinking and lean UX are essential for teams to identify the right solutions in an outcome-driven OKR framework.
-
•
AI-powered customer experiences introduce unpredictability in inputs and outputs, increasing the complexity of designing effective systems around human behavior.
-
•
Successful OKRs require both top-down strategic alignment and bottom-up team goal setting, with negotiation to ensure cohesion.
-
•
Changing incentive systems from rewarding output delivery to rewarding learning, evidence-based decision making, and customer centricity is crucial for OKR adoption.
Notable Quotes
"We can’t predict the future; all we can do is make the best guesses based on what we know right now."
"Amazon deploys new code into production into the hands of customers once every second."
"Managing towards outputs means someone has decided what the solution is going to be and told you to make that thing."
"Our goal ultimately is not to deploy a static solution but to make sure humans in the system achieve their goals successfully as often as possible."
"Objectives are qualitative, inspirational statements about the future we want to create for our customers without mentioning any solutions."
"Key results must be measures of human behavior and outcomes, not output metrics like 'launch this service'."
"Everyone has a customer — whether external users, third-party vendors, or internal colleagues; those humans consuming your product are your customers."
"If you don’t tell teams what to make, they need a product discovery process to decide what to build."
"Changing course based on evidence of actual human behavior is what agility really means."
"For OKRs to work, incentives have to focus on learning, customer centricity, and evidence-based decision making, not just delivery."
Or choose a question:
More Videos
"The outcome of this method really makes the difference between lightning and a lightning bug."
Anne MamaghaniHow Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
March 28, 2023
"This is a story about what happens when you stop trying to will others to think like you and start creating conditions under which both frames can coexist productively."
Kurt McCullochFaster alone, further together: Rebuilding collaboration in the age of AI research
March 10, 2026
"The design mindset was way more important than the bureaucratic mindset."
Sofía Delsordo Kassim VeraPublic Policy for Jalisco's Designers to Make Design Matter
December 8, 2021
"I wrote the book because people have a lot of questions about how to become a product manager or how to work with product managers or what is product."
Christian CrumlishIntroduction by our Conference Chair
December 6, 2022
"Designers should not be left to figure things out alone as we grow faster."
Ebru NamaldiDesigning the Designer’s Journey: Scaling Teams, Culture, and Growth Through DesignOps
September 11, 2025
"An ad hoc critique is best when guard is down, it’s quick, time-sensitive, and helps share early to avoid costly late feedback."
Joseph MeersmanSweating the Pixel: Scaling Quality through Critique
June 10, 2021
"When we showed the Iceland Ministry of Foreign Affairs their portfolio, the Foreign Minister said, we have to pivot our innovation investments to early-stage catalytic innovations."
Milan Guenther Benjamin KumpfThe $212 billion ‘so what?’: unlocking impact in development cooperation
November 20, 2025
"Democratization requires different approaches; there’s no one-size-fits-all solution."
Kathleen AsjesResearch Democratization: the Good, the Bad and the Ugly
March 10, 2022
"The interface becomes a radically adaptive surface—an intelligent canvas that reacts to your behavior and context."
Josh Clark Veronika KindredSentient Design, AI, and the Radically Adaptive Experience (1st of 3 seminars)
January 15, 2025
Latest Books All books
Dig deeper with the Rosenbot
In what ways are synthetic users or virtual personas currently used in research practice?
How have historical paradigm shifts affected the availability of midwifery care in the US?
How does Rally’s research infrastructure facilitate participant management and integration with enterprise data systems?