Group Activity: A Deep Dive Into Value and Outcomes
Summary
DesignOps as a practice is still relatively new—but the activities have been around long enough that we’re increasingly challenged to justify and quantify what we do. Accordingly, we need to address not just what is DesignOps, but how do we prove its value? What outcomes can we genuinely promise? And how do we know we are successful? In this group exercise, we’ll identify techniques, tactics, and tools for proving (and even measuring) value, and describing the outcomes that matter most.
Key Insights
-
•
62% of surveyed design ops professionals admit they haven’t figured out how to measure value effectively yet.
-
•
Common barriers to measuring design ops value include limited time/resources, difficulty involving the right stakeholders, and a lack of proven metrics.
-
•
Measuring value in design ops is complicated by each organization’s unique constraints and its stage on the design ops maturity journey.
-
•
Behavioral resistance can undermine measurement efforts, such as inconsistent or inaccurate time tracking despite its importance.
-
•
Non-financial and sentiment-based measurements are crucial as data alone often misses behavioral context.
-
•
Established frameworks like Google’s HEART and Facebook’s mixed methods provide adaptable foundations for design measurement.
-
•
An eight-type taxonomy of design ops measurement emerged from research and community input, organized around people, practice, and platform domains.
-
•
Effective measurement frameworks link activities to predictable outcomes (like happier designers, better designers, and more effective teams) enabling targeted metrics.
-
•
Retention and staffing remain central concerns tied to measuring design ops impact; qualitative tactics like stay interviews yield actionable insights.
-
•
Community collaboration and shared standards for design ops measurement are essential to evolving beyond the 'we don’t know yet' phase.
Notable Quotes
"When I was asked how I measure success, I said the day I no longer have to convince you."
"62% of people said literally we don't know how to measure the value of design ops yet."
"Limited time and money is not unique to design ops; it’s every single function I’ve ever seen."
"People really hated using Harvest to log billable hours, some just put the same hours week after week."
"Non-financial, non-data measurements can reveal much more about behaviors than traditional metrics."
"Google’s HEART framework is great because different teams—engineering, product, and design—can all use it."
"We have an eight-type framework for measuring design ops, but it’s a starting point, design ops is never done."
"You can’t have effective teams without happy designers and better designers; they’re interdependent."
"Stay interviews ask why people choose to stay, which provides more actionable retention data than exit interviews."
"Our call to action is to co-create these measurement standards together and share back to the community."
Or choose a question:
More Videos
"Either you need accessibility now or you will need accessibility in the future."
Sheri Byrne-HaberAccessibility at Scale
June 9, 2021
"The best products come from marrying analytics with human stories."
Prayag Narula Hannah HudsonEmpowering Designers to do Good Research
March 11, 2022
"The hardest skill to recruit for is someone who can consult and ask the right questions to uncover what the request really is."
Janelle EstesUX Research Trends
January 28, 2021
"User research is a validation function is a common pitfall, but its real power is uncovering meaningful insights early."
Craig Brookes Andreas Huebner Morgan Quinn"Just Make it Look Good" and Other Ways We're Misunderstood
June 11, 2021
"The community is an ongoing prototype; members have a strong, frequent voice in shaping what good looks like."
Marc Fonteijn Ru ButlerIncrease your confidence, influence, and impact (through a Professional Community)
December 3, 2024
"It’s challenging scaling a team with limited resources to provide comprehensive coverage to a fast-growing research function — Tim Toy, Airbnb."
Kate TowseyThe State of ResearchOps: More Than Just Theory
June 20, 2019
"Our nervous system is ancient; it can’t tell the difference between an angry email and a tiger lurking."
Alla WeinbergDesign Teams Need Psychological Safety: Here’s How to Create It
September 9, 2022
"Throwing a potluck sounds easy until you realize you don’t have a group that magically reads each other’s minds, resulting in a random table of snack foods."
Shawna Hein Kevin HoffmanCreate a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts
November 17, 2022
"Every culture has things to celebrate and improve upon; we should learn from others instead of imposing our own standards."
Tricia WangSCALE: Discussion
June 15, 2018
Latest Books All books
Dig deeper with the Rosenbot
How can large enterprises design pilot programs that effectively test new research tools without excessive delays?
What tensions exist between the healthcare industry's goals and maternal safety priorities?
How do organizations integrate customer feedback, survey data, and interview transcripts into a single research repository?