UX Research Excellence Framework
Summary
A multidisciplinary research team needs a well-crafted framework to guide their behavior, nurture their growth, and cultivate their culture. Otherwise, they feel stuck in growth and unmotivated to collaborate. Through a participatory design, the authors established a three-pillar excellence framework at Uber. First, it focuses on the research impact on product experimentation, products, roadmaps, and the company/organization. Second, it promotes creative research methods that successfully prioritize work, produce and scale rigorous insights, and empower other researchers. Third, it recognizes true partnership cross functional teams and beyond their own product area. This framework worked well at Uber for years, and recently was applied by the authors in Booking.com and Course Hero with some modifications. As this starter framework, they hope all researchers and research leaders can build their own ones based on their situations.
Key Insights
-
•
A three-part research framework focused on impact, methods, and partnership can guide teams in fast-paced, changing environments.
-
•
Prioritizing research projects using a rubric including customer impact, business impact, and collaboration quality helps clarify trade-offs and resource allocation.
-
•
An impact matrix balancing one-time, roadmap, experiment, and ongoing research types ensures a balanced and sustainable research portfolio.
-
•
Simple, scalable research methods like mobile intercept surveys can provide reliable, valid data across languages and contexts.
-
•
Moving research involvement earlier in the product development process accelerates decision-making and avoids costly mistakes.
-
•
Cross-functional partnerships with data science, engineering, and product teams are crucial for integrating research effectively and efficiently.
-
•
Recognition programs like monthly research excellence awards help sustain team motivation and highlight success.
-
•
Ethics should be embedded as a core value both in research operations and project prioritization.
-
•
Entering net new research domains requires focusing first on impact definition, then methods suited for subjective and complex human factors.
-
•
Balancing business and customer impact often reveals aligned interests rather than conflicts, as in the example of early trip cancellations improving user control.
Notable Quotes
"We developed this research framework during our time at Uber together with an extended leadership team as the team grew from 30 to 100."
"To have a strategy you need to think about how to prioritize, because you can’t do all the research requests that come in."
"Being simple is extremely complex. Adding complexity is easy, but simplicity requires discipline and focus."
"Our intercept survey is more reliable than NPS and works well even for illiterate drivers because it uses emojis as response options."
"Moving research upstream in the product process helps solve problems faster and save millions of dollars."
"We always recommend starting with one method and adding another only when absolutely needed."
"Ethics is a very important part of any user research team and should be a foundational part of how you evaluate work."
"If you’re the first researcher in a big org or new domain, focus on defining impact before deciding methodology and partnerships."
"Sometimes business and user interests seem opposed, but thoughtful research reveals ways to align them, like early trip cancellations."
"Recognition programs help create a happy, inclusive, and high-performing global team focused on impact."
Or choose a question:
More Videos
"Embracing uncertainty means diving in without knowing the outcome and creating something new every time."
Jim KalbachJazz Improvisation as a Model for Team Collaboration
November 6, 2017
"You want someone who writes with equal parts empathy and authority, not just pure authority."
Louis RosenfeldCoffee with Lou: Should You Write a (UX) Book?
March 7, 2024
"The difference between director and principal often lies in whether you’re inspired more by leading people or focused on outputs and craft."
Catt Small Micah Bennett Brian Carr Jessica HarlleeWhat's Next for ICs: Exploring Staff and Principal Designer Roles
February 22, 2024
"Less than a third of respondents feel like they work somewhere with a clear investment in customer-driven decision making."
Marieke McCloskeyUser Science: Product Analytics & User Research
March 11, 2021
"DeepFakes can look too realistic and might introduce new privacy risks if donor faces come from real people."
Llewyn Paine[Demo] Deploying AI doppelgangers to de-identify user research recordings
June 5, 2024
"Designers have a hard time interpreting econometrics-driven quantitative research without bridging approaches."
Joshua NobleCasual Inference
October 6, 2023
"Stakeholders are users too; the product we’re sharing is the research and learnings for their decision-making."
Sara LogelYour Colleagues are Your Users Too
March 29, 2023
"We'll have a centralized Slack channel for all discussion to come together as one community."
Bria Alexander Louis RosenfeldWelcome
January 8, 2024
"Confidence is a higher burden in retail because people are giving real money; inaccessible flows cause quick abandonment."
Sam ProulxOnline Shopping: Designing an Accessible Experience
June 7, 2023
Latest Books All books
Dig deeper with the Rosenbot
What strategies help UX teams translate usability findings into stakeholder-relevant outcomes like cost savings or risk reduction?
What does the acquisition of User Interviews by UserTesting mean for participants and research ops teams?
Why is the term ‘user’ problematic in UX and how can it be replaced?