Rosenverse
Research Operations at Scale

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Research Operations at Scale

Gold
Tuesday, November 7, 2017 • DesignOps Summit 2017
Share the love for this talk
Research Operations at Scale
Speakers: Christian Rohrer
Link:

Summary

Research is an inherent part of design, and operationalizing how insights are generated and used is one of the more challenging aspects of design operations. Overcoming the lack of good tools, taming the complexity of research at scale, and navigating the world of different forms of inquiry are just a few of the obstacles to overcome. That said, we are starting to see a range of benefits from implementing research operations in modern design organizations.

Key Insights

  • Banks like Capital One must manage research amid strict regulations and risk, requiring innovative recruiting and study designs.

  • Specialized research operations and curricula teams at Capital One remove procedural inefficiencies and ensure compliance.

  • Risk Management at Capital One includes embedded 'risk-sharper' roles that guide research teams through compliance challenges.

  • 'Wine and dine' sessions enable rich qualitative insights by combining customer interaction with large employee participation, without traditional focus group pitfalls.

  • User research approaches must vary by business context: B2C, B2B, and internal IT differ greatly in user access and needs.

  • Agile’s dominance in software development creates challenges for user-centered design integration, requiring adaptations or use of Lean methodologies.

  • Qualitative research provides rich user insight and inspiration for designers, while executives rely more on quantitative data for decision-making.

  • The PURE method formalizes usability evaluation through expert ratings, producing measurable scores that drive executive action and product improvement.

  • The user experience talent pool is small and highly sought after, making it critical to structure roles to attract and retain specialists rather than expecting 'unicorns.'

  • Effective knowledge management for UX research must support the entire insight lifecycle—from ideation to product impact—to avoid losing valuable learnings.

Notable Quotes

"Capital One is really a bank ... it’s out to change banking for good by becoming a tech company that just happens to do banking."

"We call it research goo: regulation, risk, inefficiencies that complicate research in banks."

"Risk-sharper is a role assigned within Risk Management that carries teams through the risk process to mitigate it."

"Wine and dine is not a focus group; it’s more employees than customers interacting in small groups to get deep insights."

"In business-to-business contexts, finding a champion within your sales or account management teams can open access to users for research."

"You need to know tomorrow’s user as well as today’s because their characteristics differ greatly according to diffusion of innovation."

"Agile is here to stay because engineering managers won’t hire for anything else; user-centered design must fit into Agile somehow."

"Designers thrive on qualitative research because it gives them access to the root of the problem beyond just numbers."

"Never put numbers on qualitative research findings; qualitative insights are about richness and why, not how many."

"The PURE method measures usability by scoring cognitive load and friction at each step of fundamental user tasks."

Ask the Rosenbot
John Maeda
About Design Organizations
2019 • DesignOps Community
Michael Land
Establishing Design Operations in Government
2021 • DesignOps Community
Charles Lee
Building a New Home for the Atlassian Design System
2020 • Enterprise Community
Jon Fukuda
The Big Question about Innovation: A Panel Discussion
2024 • DesignOps Summit 2024
Gold
Ari Zelmanow
Dark Side of Democratization
2023 • Advancing Research Community
Megan Campos
What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
2021 • Advancing Research 2021
Gold
Jon Fukuda
Theme One Intro
2022 • DesignOps Summit 2022
Gold
Yasmine Khan
Checking Bias and Listening to Financially Vulnerable Americans
2020 • Advancing Research 2020
Gold
Abbey Smalley
Scaling UX Past the Size of Your Team
2024 • Enterprise Experience 2020
Gold
John Taschek
Making People the X-Factor in the Enterprise
2018 • Enterprise Experience 2018
Gold
Carol Scott
Avoid Harming Your Team and Users: Promoting Care and Brand Reputation with Trauma-Informed UX Practices
2025 • Rosenfeld Community
Prerna Makanawala
Achieving Balanced Design Consistency
2021 • Design at Scale 2021
Gold
Gina Mendolia
Therapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems
2024 • Advancing Service Design 2024
Gold
Ariba Jahan
Team Resiliency Through a Pandemic
2024 • DesignOps Summit 2020
Gold
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • Civic Design 2022
Gold
Peter Boersma
How to Define and Maintain a DesignOps Roadmap
2023 • DesignOps Summit 2023
Gold

More Videos

Alexia Cohen

"The more participatory the practices, the deeper and more intentional the engagement needs to be."

Alexia Cohen Adriane Ackerman

Increasing Health Equity and Improving the Service Experience for Under-Served Latine Communities in Arizona

December 4, 2024

Marc Majers

"The timing is key—you want to interrupt them when they are in that flow state."

Marc Majers Tony Turner

Interrupted UX - Add A Dose of Reality To Usability Testing

March 11, 2022

Jorge Arango

"VUCA stands for volatility, uncertainty, complexity, and ambiguity."

Jorge Arango

Design as an Antidote to VUCA

May 9, 2019

Brenna Fallon

"It matters what you build, but it matters more if you learn."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Daniel Gloyd

"Companies today are embracing these principles, seeing the value of user connection and self-actualization for business success."

Daniel Gloyd

Warming the User Experience: Lessons from America's first and most radical human-centered designers

May 9, 2024

Sam Proulx

"Multiple payment providers aren’t just a feature; they’re an accessibility lifeline for people who can’t read or reach their credit card easily."

Sam Proulx

Online Shopping: Designing an Accessible Experience

October 3, 2023

Kristin Skinner

"Personalization is not just a trend; it’s a necessity."

Kristin Skinner

Five Years of DesignOps

September 29, 2021

Denise Jacobs

"Every day is a chance to check: is this how I want to be? This is a long-haul, marathon effort."

Denise Jacobs Nancy Douyon Renee Reid Lisa Welchman

Interactive Keynote: Social Change by Design

January 8, 2024

Roberta Dombrowski

"Fraud detection automatically refunds you if a participant is found to be fraudulent and helps find a replacement."

Roberta Dombrowski Lianna Aduana

5 Reasons to Bring your Recruiting in House

September 30, 2021