Group Activity: A Deep Dive Into Value and Outcomes
Summary
In this group exercise, we’ll identify techniques, tactics, and tools for proving (and even measuring) value, and describing the outcomes that matter most.
Key Insights
-
•
62% of surveyed design ops professionals admit they haven’t figured out how to measure value effectively yet.
-
•
Common barriers to measuring design ops value include limited time/resources, difficulty involving the right stakeholders, and a lack of proven metrics.
-
•
Measuring value in design ops is complicated by each organization’s unique constraints and its stage on the design ops maturity journey.
-
•
Behavioral resistance can undermine measurement efforts, such as inconsistent or inaccurate time tracking despite its importance.
-
•
Non-financial and sentiment-based measurements are crucial as data alone often misses behavioral context.
-
•
Established frameworks like Google’s HEART and Facebook’s mixed methods provide adaptable foundations for design measurement.
-
•
An eight-type taxonomy of design ops measurement emerged from research and community input, organized around people, practice, and platform domains.
-
•
Effective measurement frameworks link activities to predictable outcomes (like happier designers, better designers, and more effective teams) enabling targeted metrics.
-
•
Retention and staffing remain central concerns tied to measuring design ops impact; qualitative tactics like stay interviews yield actionable insights.
-
•
Community collaboration and shared standards for design ops measurement are essential to evolving beyond the 'we don’t know yet' phase.
Notable Quotes
"When I was asked how I measure success, I said the day I no longer have to convince you."
"62% of people said literally we don't know how to measure the value of design ops yet."
"Limited time and money is not unique to design ops; it’s every single function I’ve ever seen."
"People really hated using Harvest to log billable hours, some just put the same hours week after week."
"Non-financial, non-data measurements can reveal much more about behaviors than traditional metrics."
"Google’s HEART framework is great because different teams—engineering, product, and design—can all use it."
"We have an eight-type framework for measuring design ops, but it’s a starting point, design ops is never done."
"You can’t have effective teams without happy designers and better designers; they’re interdependent."
"Stay interviews ask why people choose to stay, which provides more actionable retention data than exit interviews."
"Our call to action is to co-create these measurement standards together and share back to the community."
Or choose a question:
More Videos
"We encourage one-to-one video calls to build rapport and feel comfortable reaching out for advice."
Marc Fonteijn Ru ButlerIncrease your confidence, influence, and impact (through a Professional Community)
December 3, 2024
"Design’s value is in asking meaningful questions and steering towards the right outcome, not getting bogged down in technical parameters."
Dem Gerolemou Alexis Oh Neef RehmanClimate technology fundamentals
May 15, 2024
"We use a holistic methodological approach combining explicit and implicit quantitative methods to fully get the user's perspective."
Daniela Magaña Flores Ariane Rahn Jeff Ephraim BanderAhead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
March 10, 2022
"Not growing the team was disheartening but led me to create training for partners to start taking a user-centered approach themselves."
Abbey Smalley Sylas SouzaScaling UX Past the Size of Your Team
January 8, 2024
"Our CIO, Fletcher Prev, has always made the employee experience his North Star."
Patrick CommarfordDesign Staffing for Impact
January 8, 2024
"We mapped every individual journey on Google Earth attaching quotations and photographs to each location to represent human experiences."
Xenia Adjoubei Sean BruceEmpowering Communities Through the Researcher in Residence Program
March 29, 2023
"If you’re not paying for the product, you are the product."
Craig VillamorDesign Systems for Ethical Design
January 26, 2023
"Fostering a culture of use and leadership is essential to make these tools part of daily rituals."
Jon Fukuda Ellie KryslDesign Planning and Management Support
October 3, 2023
"Our hypothesis was we could create better product faster with more eyes looking at the problem, not just product."
Iain McMaster IHan ChengDesign and Product: from Frenemy to Harmony
November 29, 2023
Latest Books All books
Dig deeper with the Rosenbot
What privacy and security considerations arise when using AI with participant data in research tools?
What are the core UX research tools essential for managing participant recruitment and study logistics in large companies?
How can you introduce play to new teams or virtual environments carefully and effectively?