Rosenverse
Measuring the Designer Experience

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Measuring the Designer Experience

Gold
Wednesday, October 23, 2019 • DesignOps Summit 2019
Share the love for this talk
Measuring the Designer Experience
Speakers: Kim Fellman Cohen
Link:

Summary

DesignOps teams are increasingly being leveraged to solve ambiguous organizational problems like career development, culture or belonging—they’re cornerstones for any successful team. Creating a measurable strategy for these problems is complex, and it can be hard to prove the value of dedicating full-time resources to maintain this work in the long-run. Based on our learnings at Pinterest, I’ll share tactical approaches you can take to craft programming for this problem space, define what ideal states look like and how you can measure and prove value.

Key Insights

  • •

    Design operations teams can effectively solve complex people and culture problems beyond traditional product focus.

  • •

    Design thinking methods adapted from product work can be used to prototype and iterate on people programs.

  • •

    Collecting real-time qualitative feedback through mixed methods builds empathy and more actionable insights than stale surveys.

  • •

    Defining problems with the right scope and clarity helps generate practical, testable solutions.

  • •

    Including a diverse mix of stakeholders and experts in ideation fosters ownership and buy-in.

  • •

    Establishing measurable objectives linked to concrete numbers enables tracking and proving program impact.

  • •

    Piloting ideas with small groups and embracing failure as learning accelerates refinement of solutions.

  • •

    Regular, transparent reporting to leadership creates trust and supports securing ongoing resources.

  • •

    Balancing long-term strategic bets with quick wins avoids overwhelm and sustains momentum.

  • •

    Even modest improvements in team health metrics can translate into meaningful gains in retention and morale.

Notable Quotes

"People problems find their way to design ops because we’re known problem solvers and people run to us when morale is low."

"What does ‘best work’ mean? It’s different for everyone, so our solutions have to be flexible and meaningful."

"Design thinking helped us empathize, define problems, co-create ideas, and then test them like products."

"Focus groups build empathy by letting team members share their experiences in real time."

"Our first problem statement was too big, so we refined it to something more doable and actionable."

"If you don’t have the support you need—budget, time, people—your program is at high risk of failure."

"Pilots don’t need to be perfect, they just need enough moving parts to gather useful feedback quickly."

"Failure isn’t discouraging; it’s an opportunity to learn and improve your approach."

"Reporting progress with data and stories opens up opportunities with stakeholders and builds credibility."

"Our team’s improvement wasn’t the final state—we set ambitious goals to be in the 80th to 90th percentile next year."

Ask the Rosenbot
JD Buckley
Communicating the ROI of UX within a large enterprise and out on the streets
2018 • Enterprise Experience 2018
Gold
Sarit Geertjes
People, not Petri Dishes: Stories from a Research Recruiter
2019 • DesignOps Community
Rachael Dietkus, LCSW
AI: Passionate defenses and reasoned critique [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Bria Alexander
Theme 1 Intro
2024 • DesignOps Summit 2024
Gold
Dominique Ward
The Most Exciting Time for DesignOps is Now
2022 • DesignOps Summit 2022
Gold
Marc Fonteijn
Increase your confidence, influence, and impact (through a Professional Community)
2024 • Advancing Service Design 2024
Gold
Erin Hauber
Design is Not the Frosting on the Scaled Agile Layer Cake
2019 • DesignOps Summit 2019
Gold
Andrew Michael
Building a Product Insights Team
2022 • Advancing Research 2022
Gold
Bria Alexander
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Katie Hansen
Experimental research: techniques for deep, psychology-driven insights
2025 • Advancing Research 2025
Gold
Jen Cardello
Learning Velocity—The Insights Speedometer
2021 • Advancing Research Community
Bassel Deeb
Do More With Less: Equip and Lead Design Orgs Through Adversity
2023 • DesignOps Summit 2023
Gold
Michael Polivka
Scaling Design through Relationship Maps
2017 • DesignOps Summit 2017
Gold
Bria Alexander
Opening Remarks Day 1
2024 • Advancing Research 2024
Gold
Steve Portigal
Discussion
2015 • Enterprise UX 2015
Gold
Ovetta Sampson
Managing the Human Engagement Risks of AI
2025 • Designing with AI 2025
Gold

More Videos

Mark Interrante

"The risk of AI is that it will over-rely on past priorities and miss new, emerging signals."

Mark Interrante Harry Max

AI for Prioritization (3rd of 3 seminars)

July 11, 2024

Patrizia Bertini

"Building product today is getting more and more complex, and organizations desperately need professionals who speak compliance and product."

Patrizia Bertini

The (r)evolution of designOps: It’s Time to Think (really) BIG

September 11, 2025

Shan Shen

"Translation is key to earn the seat at the table."

Shan Shen

Translating UX Terms into Business Contexts

November 29, 2023

Adam Thomas

"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."

Adam Thomas

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

December 6, 2022

Robin Beers

"Research really is the most predictive practice an organization has — we are the only ones who can really predict the future."

Robin Beers

Research as a Catalyst for Organizational Transformation

March 12, 2021

Sheri Byrne-Haber

"If you’re rewarding designers for delivering on time, great, but if you reward them for delivering accessible products on time, you’ll get better results."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Joseph Meersman

"Critiques help teams stop being the lone ranger and instead iterate faster together with purpose and clarity."

Joseph Meersman

Sweating the Pixel: Scaling Quality through Critique

June 10, 2021

Deanna Washington

"Go meet someone new at this conference and set up a coffee chat next week."

Deanna Washington Bria Alexander Jon Fukuda Saara Kamppari-Miller Farid Sabitov

Connecting the Ops: Plenary Panel and Closing Circle

September 9, 2022

Aaron Stienstra

"Customer experience cannot truly be good if some are left out or excluded, either intentionally or unintentionally."

Aaron Stienstra Lashanda Hodge

Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government

December 8, 2021