Rosenverse
Research Operations at Scale

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Research Operations at Scale

Gold
Tuesday, November 7, 2017 • DesignOps Summit 2017
Share the love for this talk
Research Operations at Scale
Speakers: Christian Rohrer
Link:

Summary

Research is an inherent part of design, and operationalizing how insights are generated and used is one of the more challenging aspects of design operations. Overcoming the lack of good tools, taming the complexity of research at scale, and navigating the world of different forms of inquiry are just a few of the obstacles to overcome. That said, we are starting to see a range of benefits from implementing research operations in modern design organizations.

Key Insights

  • Banks like Capital One must manage research amid strict regulations and risk, requiring innovative recruiting and study designs.

  • Specialized research operations and curricula teams at Capital One remove procedural inefficiencies and ensure compliance.

  • Risk Management at Capital One includes embedded 'risk-sharper' roles that guide research teams through compliance challenges.

  • 'Wine and dine' sessions enable rich qualitative insights by combining customer interaction with large employee participation, without traditional focus group pitfalls.

  • User research approaches must vary by business context: B2C, B2B, and internal IT differ greatly in user access and needs.

  • Agile’s dominance in software development creates challenges for user-centered design integration, requiring adaptations or use of Lean methodologies.

  • Qualitative research provides rich user insight and inspiration for designers, while executives rely more on quantitative data for decision-making.

  • The PURE method formalizes usability evaluation through expert ratings, producing measurable scores that drive executive action and product improvement.

  • The user experience talent pool is small and highly sought after, making it critical to structure roles to attract and retain specialists rather than expecting 'unicorns.'

  • Effective knowledge management for UX research must support the entire insight lifecycle—from ideation to product impact—to avoid losing valuable learnings.

Notable Quotes

"Capital One is really a bank ... it’s out to change banking for good by becoming a tech company that just happens to do banking."

"We call it research goo: regulation, risk, inefficiencies that complicate research in banks."

"Risk-sharper is a role assigned within Risk Management that carries teams through the risk process to mitigate it."

"Wine and dine is not a focus group; it’s more employees than customers interacting in small groups to get deep insights."

"In business-to-business contexts, finding a champion within your sales or account management teams can open access to users for research."

"You need to know tomorrow’s user as well as today’s because their characteristics differ greatly according to diffusion of innovation."

"Agile is here to stay because engineering managers won’t hire for anything else; user-centered design must fit into Agile somehow."

"Designers thrive on qualitative research because it gives them access to the root of the problem beyond just numbers."

"Never put numbers on qualitative research findings; qualitative insights are about richness and why, not how many."

"The PURE method measures usability by scoring cognitive load and friction at each step of fundamental user tasks."

Ask the Rosenbot
Dem Gerolemou
Climate technology fundamentals
2024 • Climate UX Interest Group
Clemens Janssen
Efficiently Scaling Research as a Team of One
2023 • Advancing Research 2023
Gold
Devon Powers
Imagining Better Futures
2022 • Advancing Research 2022
Gold
Kurdin Bazaz
Culture, DIBS & Recruiting
2021 • Design at Scale 2021
Gold
Uday Gajendar
Day 2 Welcome
2024 • Designing with AI 2024
Gold
Megan Blocker
What UX research maturity looks like and how we get there [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Peter Van Dijck
Building the Rosenbot
2024 • Designing with AI 2024
Gold
Ned Dwyer
The Intersection of Design and ResearchOps
2024 • DesignOps Summit 2024
Gold
Elizabeth Sklar
Co-creating research enablement with your tech org: a case study
2026 • Advancing Research 2026
Gold
Emily Danielson
“I mean, I can lift a shovel”: Design Skills in Disaster Response
2022 • Design at Scale 2022
Gold
Asia Hoe
Partnering with Product: A Journey from Junior to Senior Design
2023 • Design in Product 2023
Gold
Adam Cutler
Discussion
2016 • Enterprise UX 2016
Gold
Saara Kamppari-Miller
Cartography for Design Communities
2025 • DesignOps Summit 2025
Gold
Nicole Wright
Democratizing Research at HoneyBook
2022 • Advancing Research 2022
Gold
Chris Moses
Stretching the Definition of DesignOps with Product Development
2018 • DesignOps Summit 2018
Gold
Nancy Douyon
We'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex
2018 • Enterprise Experience 2018
Gold

More Videos

Nick Cochran

"Treat every conversation as an opportunity to make new connections."

Nick Cochran

Growing in Enterprise Design through Making Connections

June 20, 2019

Amber Knabl

"It’s way more cost effective to catch accessibility issues during the design phase than after shipping a product."

Amber Knabl

Empowering innovation: The critical role of inclusive product development in the AI era

June 4, 2024

Nora Tejeda

"It’s not that developers want to do design, they need to do it because they need to keep working on their projects."

Nora Tejeda Giovanna Alonso

Scaling Design Capabilities at BBVA Through a Self-service Design Model

June 10, 2021

Nathan Shedroff

"Emotions last 30 to 120 seconds, but identity and meaningful value go much deeper in relationships with products."

Nathan Shedroff

Redefining Value: Bridging the Innovation Culture Divide

May 14, 2015

Lona Moore

"Many design champions started as non-designers and transitioned into design careers after becoming community leads."

Lona Moore

Scaling Design Beyond Designers

June 11, 2021

Jemma Ahmed

"If I am difficult, then I am in good company, esteemed company, the best of company."

Jemma Ahmed

Theme 2 Intro

March 26, 2024

Sabrina Mach

"A false start means design is not considered first, leading to rework, cost loss, and product failure."

Sabrina Mach Nina Wainwright

How to Design Your Design Operating Model

September 29, 2021

Kevin M. Hoffman

"We are a B2D company – business to dog – making technology so dogs can speak English to people and each other."

Kevin M. Hoffman

Theme 2: Enterprise Team Journey

June 3, 2019

Bria Alexander

"Sponsor sessions may require registration by email to prevent Zoom bombings and protect session integrity."

Bria Alexander Louis Rosenfeld

Welcome

January 8, 2024