Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation

Thursday, September 22, 2022 • Enterprise Community
Share the love for this talk
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
Speakers: Jack Moffett
Link:

Summary

At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.

Key Insights

  • Effective UX metrics balance qualitative surveys and quantitative user behavior data.

  • Setting fixed outcome targets like NPS scores is less useful than tracking improvement trends.

  • Triangulating metrics (NPS, CSAT, CES) provides richer understanding than relying on a single measure.

  • UX success metrics differ from product usage metrics by focusing on user goal completion not just feature adoption.

  • Embedding metrics collection proactively in agile workflows improves product evaluation.

  • UX teams face the challenge of persuading stakeholders to prioritize improvements based on metrics insights.

  • There is often organizational resistance to collecting UX data due to fear of low scores and blame culture.

  • Enterprise UX conferences struggle to balance community identity with attracting interdisciplinary participants.

  • Design influence requires skills beyond craft, including strategy, culture shaping, and business alignment.

  • Expanding UX definition beyond UI to include marketing, documentation, and product architecture is critical for organizational impact.

Notable Quotes

"It's not about hitting a specific NPS target but about improving from where we are now and tracking the trend."

"You don't know if you're successful until your users are successful in accomplishing their goals using your product."

"Too many teams think delivering software means success, but actual success is user achievement with the product."

"Triangulation is key — compare multiple metrics to understand why scores move the way they do."

"Proactive measurement before release combined with post-release evaluation is the ideal approach."

"We often need to evangelize the importance of collecting UX metrics to teams and leadership."

"UX is more than UI; it's the entire product, including marketing, documentation, and architecture."

"Design influence is messy and requires clear articulation of how we serve business and customer success."

"Executives like NPS because it’s a simple, quick-to-understand number, even if they don’t fully grasp its nuances."

"Culture needs to accept failure as part of learning so we can improve rather than assign blame."

Ask the Rosenbot
Catherine Dubut
Bridging Physical and Digital Spaces: Approaches to Retail Service Design
2021 • Enterprise Community
Dr. Jamika D. Burge
A Genuine Conversation about the Future of UX Research
2024 • Advancing Research Community
Patrizia Bertini
The (r)evolution of designOps: It’s Time to Think (really) BIG
2025 • DesignOps Summit 2025
Gold
Ilana Lipsett
Anticipating Risk, Regulating Tech: A Playbook for Ethical Technology Governance
2021 • Civic Design 2021
Gold
Bas Raijmakers, PhD (RCA)
What Design Research can Learn from Documentary Filmmaking
2022 • Advancing Research 2022
Gold
Christian Madsbjerg
Influencing Strategy
2020 • Advancing Research 2020
Gold
Maria Skaaden
Continuous Design: One eye on the horizon and the other on the next wave
2018 • DesignOps Summit 2018
Gold
Shipra Kayan
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
2021 • DesignOps Summit 2021
Gold
Aurobinda Pradhan
Introduction to Collaborative DesignOps using Cubyts
2022 • DesignOps Summit 2022
Gold
Roy Opata Olende
How Zapier Uses ‘All Hands Research’ to Increase Exposure to Users
2020 • Advancing Research Community
Megan Clegg
Space for Everyone: Reframing Accessibility Through a Wider Lens
2021 • Design at Scale 2021
Gold
Megan Blocker
What UX research maturity looks like and how we get there [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Husani Oakley
Theme Two Intro
2023 • Enterprise UX 2023
Gold
Julie Gitlin
Design as an Agent of Digital Transformation at JPMC
2021 • Design at Scale 2021
Gold
Jemma Ahmed
Theme 2 Intro
2024 • Advancing Research 2024
Gold
George Zhang
UX Research Excellence Framework
2021 • Advancing Research 2021
Gold

More Videos

Sheri Byrne-Haber

"Accessibility defects are bugs. If it’s a P1 blocking bug for an accessibility issue, treat it like any other P1 bug."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Prayag Narula

"When UX researchers and product managers collaborate, the product speaks to users’ hearts."

Prayag Narula Hannah Hudson

Empowering Designers to do Good Research

March 11, 2022

Janelle Estes

"If you build something that's easy to use but not what people want, it doesn't matter."

Janelle Estes

UX Research Trends

January 28, 2021

Craig Brookes

"Our customers actually live in Siberia and they don't want ice cream, they want hot cookies out of the oven."

Craig Brookes Andreas Huebner Morgan Quinn

"Just Make it Look Good" and Other Ways We're Misunderstood

June 11, 2021

Marc Fonteijn

"If you don’t feel connected and you’re standing alone, the challenge looks much bigger."

Marc Fonteijn Ru Butler

Increase your confidence, influence, and impact (through a Professional Community)

December 3, 2024

Kate Towsey

"Research ops allows me to indulge my geeky planning spreadsheety side as well as my people-loving supportive side — Saskia, Delivery."

Kate Towsey

The State of ResearchOps: More Than Just Theory

June 20, 2019

Alla Weinberg

"Psychological safety is the foundation; without it you get a culture of transaction and silence."

Alla Weinberg

Design Teams Need Psychological Safety: Here’s How to Create It

September 9, 2022

Shawna Hein

"We treat our shared tooling and design system as a product with a dedicated team maintaining reusable components and governance."

Shawna Hein Kevin Hoffman

Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts

November 17, 2022

Tricia Wang

"You have to find mentors and sponsors who leverage their privilege to help you get as far as possible."

Tricia Wang

SCALE: Discussion

June 15, 2018