Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
Summary
At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.
Key Insights
-
•
Effective UX metrics balance qualitative surveys and quantitative user behavior data.
-
•
Setting fixed outcome targets like NPS scores is less useful than tracking improvement trends.
-
•
Triangulating metrics (NPS, CSAT, CES) provides richer understanding than relying on a single measure.
-
•
UX success metrics differ from product usage metrics by focusing on user goal completion not just feature adoption.
-
•
Embedding metrics collection proactively in agile workflows improves product evaluation.
-
•
UX teams face the challenge of persuading stakeholders to prioritize improvements based on metrics insights.
-
•
There is often organizational resistance to collecting UX data due to fear of low scores and blame culture.
-
•
Enterprise UX conferences struggle to balance community identity with attracting interdisciplinary participants.
-
•
Design influence requires skills beyond craft, including strategy, culture shaping, and business alignment.
-
•
Expanding UX definition beyond UI to include marketing, documentation, and product architecture is critical for organizational impact.
Notable Quotes
"It's not about hitting a specific NPS target but about improving from where we are now and tracking the trend."
"You don't know if you're successful until your users are successful in accomplishing their goals using your product."
"Too many teams think delivering software means success, but actual success is user achievement with the product."
"Triangulation is key — compare multiple metrics to understand why scores move the way they do."
"Proactive measurement before release combined with post-release evaluation is the ideal approach."
"We often need to evangelize the importance of collecting UX metrics to teams and leadership."
"UX is more than UI; it's the entire product, including marketing, documentation, and architecture."
"Design influence is messy and requires clear articulation of how we serve business and customer success."
"Executives like NPS because it’s a simple, quick-to-understand number, even if they don’t fully grasp its nuances."
"Culture needs to accept failure as part of learning so we can improve rather than assign blame."
Or choose a question:
More Videos
"Accessibility defects are bugs. If it’s a P1 blocking bug for an accessibility issue, treat it like any other P1 bug."
Sheri Byrne-HaberAccessibility at Scale
June 9, 2021
"When UX researchers and product managers collaborate, the product speaks to users’ hearts."
Prayag Narula Hannah HudsonEmpowering Designers to do Good Research
March 11, 2022
"If you build something that's easy to use but not what people want, it doesn't matter."
Janelle EstesUX Research Trends
January 28, 2021
"Our customers actually live in Siberia and they don't want ice cream, they want hot cookies out of the oven."
Craig Brookes Andreas Huebner Morgan Quinn"Just Make it Look Good" and Other Ways We're Misunderstood
June 11, 2021
"If you don’t feel connected and you’re standing alone, the challenge looks much bigger."
Marc Fonteijn Ru ButlerIncrease your confidence, influence, and impact (through a Professional Community)
December 3, 2024
"Research ops allows me to indulge my geeky planning spreadsheety side as well as my people-loving supportive side — Saskia, Delivery."
Kate TowseyThe State of ResearchOps: More Than Just Theory
June 20, 2019
"Psychological safety is the foundation; without it you get a culture of transaction and silence."
Alla WeinbergDesign Teams Need Psychological Safety: Here’s How to Create It
September 9, 2022
"We treat our shared tooling and design system as a product with a dedicated team maintaining reusable components and governance."
Shawna Hein Kevin HoffmanCreate a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts
November 17, 2022
"You have to find mentors and sponsors who leverage their privilege to help you get as far as possible."
Tricia WangSCALE: Discussion
June 15, 2018