Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
Summary
Measuring DesignOps value is surprisingly complicated. Many practitioners would agree with the sentiment that measuring their impact feels aspirational at best, and theoretical at worst. Anecdotal evidence and praise from partners (“I don't know what we’d do without you!”) is nice, but doesn’t add up to proof that DesignOps is a worthy return on investment. In this talk, we’ll share two novel approaches to measuring DesignOps success from our upcoming book, The Design Conductors: Your Essential Guide to Design Operations. These methods–the “Jobs to Be Done” and “HEROES” frameworks–can be used to uncover and define measures of value that more accurately capture the impact DesignOps (and design) has on a business and its stakeholders. We will also share some tested rubrics that DesignOps can use to prioritize and implement these new measures.
Key Insights
-
•
Traditional business metrics are often too narrow to capture the full value of design operations.
-
•
Only about 50% of design ops practitioners have clearly defined metrics; just 41% measure design ops impact.
-
•
The Jobs to Be Done framework can be adapted to design ops to define measurable outcomes linked to stakeholder needs.
-
•
The Hero's Framework categorizes design ops impact into six areas: Health, Effectiveness, Readiness, Outcomes, Ecosystem, and Sentiment.
-
•
Design ops should measure metrics tailored to their organization's mission, operating model, and current workstreams for best results.
-
•
Expansion and contraction business phases affect which design ops metrics and outcomes teams should prioritize.
-
•
Outcome-driven prioritization factors (success, progress, problem) help ensure metrics focus on improving change, not just status quo.
-
•
Visibility of design ops work is critical to securing investment and recognition from leadership, as noted by Jared Spool and Sarah Walker Bocher.
-
•
Measurement frameworks should help design ops move away from measuring all things to measuring what truly matters for impact and sustainability.
-
•
The example of a Gen AI Summer Camp showed how design ops used readiness metrics and qualitative feedback to demonstrate tangible value.
Notable Quotes
"Measuring wrong can cost you half a billion dollars, but also what you measure and how you measure matters a lot."
"Design ops isn’t rocket science, but between us it might actually be harder."
"Design ops is a flexible and adaptable practice, meaning our goals and outcomes are usually more fluid than stable."
"Applying traditional frameworks to design ops is like trying to fit a star in a box."
"Design teams don’t want a design ops drill, they need a quarter inch hole that requires a little bit of program management."
"Healthy teams are the foundation of a healthy organization."
"Every hiccup in a process and every outdated protocol accumulates a toll on the team as well as financial costs."
"Visibility is the most vital thing for UX leaders to be focused on."
"Endlessly justifying yourself rarely changes others’ opinions. It positions design ops as up for debate."
"We choose to measure design ops value not because it is easy, but because it is hard."
Or choose a question:
More Videos
"If a dialog pops up but the keyboard focus isn’t moved into it, a screen reader user might not know it’s there."
Sam ProulxEverything You Ever Wanted to Know About Screen Readers
June 11, 2021
"Even though we are virtual, we are still community and must treat each other with kindness and respect."
Bria AlexanderOpening Remarks
November 17, 2022
"Don’t force yourself into a job you know isn’t right just because you’re unemployed."
Corey Nelson Amy SanteeLayoffs
November 15, 2022
"The purpose of a system is what it does—so you can measure an enterprise by its outcomes, not just by its slogans or strategy documents."
Milan GuentherA Shared Language for Co-Creating Ambitious Endeavours
June 6, 2023
"If we can’t provide research as a service at scale, we need to make sure the teams are equipped to do it on their own."
Erin May Roberta Dombrowski Laura Oxenfeld Brooke HintonDistributed, Democratized, Decentralized: Finding a Research Model to Support Your Org
March 10, 2022
"When blind users choose between Android and iPhone, they weigh trade-offs between stability and customizability."
Sam ProulxUnderstanding Screen Readers on Mobile: How And Why to Learn from Native Users
June 6, 2023
"It often feels like research becomes beholden to exact quotes rather than the richer story that context provides, what I call the tyranny of transcripts."
Mujtaba HameedThe new horizon of ethnography: using AI to unlock the full potential of in-person research
March 11, 2026
"Ethical technology governance means anticipating the long-term social impacts of technology today and acting to protect essential public goods."
Ilana LipsettAnticipating Risk, Regulating Tech: A Playbook for Ethical Technology Governance
December 10, 2021
"If we think about training AI on the average, then what we will get is more of the same."
Samuel ProulxFrom Standards to Innovation: Why Inclusive Design Wins
September 10, 2025
Latest Books All books
Dig deeper with the Rosenbot
What does the acquisition of User Interviews by UserTesting mean for participants and research ops teams?
Why is the emerging AI integration in healthcare seen as a major opportunity for UX professionals?
How does healthcare UX balance creativity with strict regulatory compliance and safety requirements?