Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

UX Research Excellence Framework

Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
UX Research Excellence Framework
Speakers: George Zhang and Molly Stevens
Link:

Summary

A multidisciplinary research team needs a well-crafted framework to guide their behavior, nurture their growth, and cultivate their culture. Otherwise, they feel stuck in growth and unmotivated to collaborate. Through a participatory design, the authors established a three-pillar excellence framework at Uber. First, it focuses on the research impact on product experimentation, products, roadmaps, and the company/organization. Second, it promotes creative research methods that successfully prioritize work, produce and scale rigorous insights, and empower other researchers. Third, it recognizes true partnership cross functional teams and beyond their own product area. This framework worked well at Uber for years, and recently was applied by the authors in Booking.com and Course Hero with some modifications. As this starter framework, they hope all researchers and research leaders can build their own ones based on their situations.

Key Insights

  • A three-part research framework focused on impact, methods, and partnership can guide teams in fast-paced, changing environments.

  • Prioritizing research projects using a rubric including customer impact, business impact, and collaboration quality helps clarify trade-offs and resource allocation.

  • An impact matrix balancing one-time, roadmap, experiment, and ongoing research types ensures a balanced and sustainable research portfolio.

  • Simple, scalable research methods like mobile intercept surveys can provide reliable, valid data across languages and contexts.

  • Moving research involvement earlier in the product development process accelerates decision-making and avoids costly mistakes.

  • Cross-functional partnerships with data science, engineering, and product teams are crucial for integrating research effectively and efficiently.

  • Recognition programs like monthly research excellence awards help sustain team motivation and highlight success.

  • Ethics should be embedded as a core value both in research operations and project prioritization.

  • Entering net new research domains requires focusing first on impact definition, then methods suited for subjective and complex human factors.

  • Balancing business and customer impact often reveals aligned interests rather than conflicts, as in the example of early trip cancellations improving user control.

Notable Quotes

"We developed this research framework during our time at Uber together with an extended leadership team as the team grew from 30 to 100."

"To have a strategy you need to think about how to prioritize, because you can’t do all the research requests that come in."

"Being simple is extremely complex. Adding complexity is easy, but simplicity requires discipline and focus."

"Our intercept survey is more reliable than NPS and works well even for illiterate drivers because it uses emojis as response options."

"Moving research upstream in the product process helps solve problems faster and save millions of dollars."

"We always recommend starting with one method and adding another only when absolutely needed."

"Ethics is a very important part of any user research team and should be a foundational part of how you evaluate work."

"If you’re the first researcher in a big org or new domain, focus on defining impact before deciding methodology and partnerships."

"Sometimes business and user interests seem opposed, but thoughtful research reveals ways to align them, like early trip cancellations."

"Recognition programs help create a happy, inclusive, and high-performing global team focused on impact."

Ask the Rosenbot
Sheryl Cababa
Living in the Clouds: Adopting a Systems Thinking Mindset
2023 • Enterprise UX 2023
Gold
Yoel Sumitro
Actions and Reflections: Bridging the Skills Gap among Researchers
2022 • Advancing Research 2022
Gold
Laura Weiss
There is No Playbook: Leader as Coach During Challenging Times
2024 • Rosenfeld Community
Amy Marquez
INVEST: Discussion
2018 • Enterprise Experience 2018
Gold
Jackie Velasquez-Ross
Talent Acquisition and Our Responsibility
2020 • DesignOps Community
Jennifer Kong
Journeying toward AI-assisted documentation in healthcare
2024 • Designing with AI 2024
Gold
Allison Sanders
Operating with Purpose
2024 • DesignOps Summit 2020
Gold
Tristin Oldani
Turning awareness into action with Climate UX
2025 • Climate UX Interest Group
Abbey Smalley
Today’s Design Ops and Programs Landscape & Career Paths
2023 • DesignOps Summit 2023
Gold
Dane DeSutter
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
2024 • Advancing Research 2024
Gold
Christian Crumlish
Introduction by our Conference Chair
2022 • Design in Product 2022
Gold
Bria Alexander
Charting the future of DesignOps: A community workshop
2024 • DesignOps Community
Ariel Kennan
Civic Design in 2022
2022 • Civic Design Community
Richard Buchanan
Creativity and Principles in the Flourishing Enterprise
2018 • Enterprise Experience 2018
Gold
Sarah Brooks
Fireside chat with Sarah Brooks and Jen Pahlka
2021 • Civic Design Community
Erin May
Distributed, Democratized, Decentralized: Finding a Research Model to Support Your Org
2022 • Advancing Research 2022
Gold

More Videos

Daniel Gloyd

"Patricia Moore’s aging research revealed how product design often excludes elderly users by living their constraints."

Daniel Gloyd

Designing From the Inside Out: How Method Acting Can Inspire Design Research

February 12, 2026

Deirdre Hirschtritt

"Flour is the core structure of our relationships. Like gluten makes dough stronger, background research makes relationships stronger."

Deirdre Hirschtritt Cesar Paredes Marie Perrot

Research is Only as Good as the Relationships You Build

November 17, 2022

Benjamin Real

"We chose to focus on research because we wanted to mirror, a bit more robust, the capability of the design teams to understand client needs."

Benjamin Real

Maturity Models: A Core Tool for Creating a DesignOps Strategy

October 1, 2021

Max Gadney

"You can look at a company’s impact reports and funding sources to sniff out if something feels too good to be true."

Max Gadney Andrea Petrucci Joshua Stehr Hannah Wickes

Assessing UX jobs for impact in climate

August 14, 2024

Lada Gorlenko

"Ivana will teach you how to scale fast and big from day one through product operations."

Lada Gorlenko

Theme 1: Intro

January 8, 2024

Feyikemi Akinwolemiwa

"In a world of AI where things are speeding up, it's more important than ever to position ourselves as teams that can actually change things."

Feyikemi Akinwolemiwa

Play to innovate: How curiosity and experimentation transform UX

March 11, 2026

Bria Alexander

"There is no need to take notes. Our session notes, resources, videos, and slide decks will all be shared on the website."

Bria Alexander

Opening Remarks

March 29, 2023

Llewyn Paine

"Even if you’re not doing facial recognition, storing face and voice data is under growing legal scrutiny."

Llewyn Paine

[Demo] Deploying AI doppelgangers to de-identify user research recordings

June 5, 2024

Bria Alexander

"When teams are connected to real strategic missions and own their key results, OKRs become positive."

Bria Alexander Benson Low Natalya Pemberton Stephanie Goldthorpe

OKRs—Helpful or Harmful?

January 20, 2022