Research Operations at Scale
Summary
Key Insights
-
•
Banks like Capital One must manage research amid strict regulations and risk, requiring innovative recruiting and study designs.
-
•
Specialized research operations and curricula teams at Capital One remove procedural inefficiencies and ensure compliance.
-
•
Risk Management at Capital One includes embedded 'risk-sharper' roles that guide research teams through compliance challenges.
-
•
'Wine and dine' sessions enable rich qualitative insights by combining customer interaction with large employee participation, without traditional focus group pitfalls.
-
•
User research approaches must vary by business context: B2C, B2B, and internal IT differ greatly in user access and needs.
-
•
Agile’s dominance in software development creates challenges for user-centered design integration, requiring adaptations or use of Lean methodologies.
-
•
Qualitative research provides rich user insight and inspiration for designers, while executives rely more on quantitative data for decision-making.
-
•
The PURE method formalizes usability evaluation through expert ratings, producing measurable scores that drive executive action and product improvement.
-
•
The user experience talent pool is small and highly sought after, making it critical to structure roles to attract and retain specialists rather than expecting 'unicorns.'
-
•
Effective knowledge management for UX research must support the entire insight lifecycle—from ideation to product impact—to avoid losing valuable learnings.
Notable Quotes
"Capital One is really a bank ... it’s out to change banking for good by becoming a tech company that just happens to do banking."
"We call it research goo: regulation, risk, inefficiencies that complicate research in banks."
"Risk-sharper is a role assigned within Risk Management that carries teams through the risk process to mitigate it."
"Wine and dine is not a focus group; it’s more employees than customers interacting in small groups to get deep insights."
"In business-to-business contexts, finding a champion within your sales or account management teams can open access to users for research."
"You need to know tomorrow’s user as well as today’s because their characteristics differ greatly according to diffusion of innovation."
"Agile is here to stay because engineering managers won’t hire for anything else; user-centered design must fit into Agile somehow."
"Designers thrive on qualitative research because it gives them access to the root of the problem beyond just numbers."
"Never put numbers on qualitative research findings; qualitative insights are about richness and why, not how many."
"The PURE method measures usability by scoring cognitive load and friction at each step of fundamental user tasks."
Or choose a question:
More Videos
"Prioritization work is a political process, and politics are hard to do in technology."
Mark Interrante Harry MaxAI for Prioritization (3rd of 3 seminars)
July 11, 2024
"The more the compliance level increased, the higher the cost efficiency."
Patrizia BertiniThe (r)evolution of designOps: It’s Time to Think (really) BIG
September 11, 2025
"You want to be strict in what you emit but liberal in what you accept, to be clear and precise but also give some grace."
Shan ShenTranslating UX Terms into Business Contexts
November 29, 2023
"Stop, pivot, or invest early—these are the survival metric decisions that save companies."
Adam ThomasSurvival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
December 6, 2022
"We’re still operating from an industrial era hangover — a mechanistic way of problem solving that doesn’t fit today’s complexity."
Robin BeersResearch as a Catalyst for Organizational Transformation
March 12, 2021
"Assistive technology has to communicate with the destination, that’s your website or product."
Sheri Byrne-HaberAccessibility at Scale
June 9, 2021
"Critiques maintain focus on the quality of our outcomes and sweat every pixel we put in the hands of our users."
Joseph MeersmanSweating the Pixel: Scaling Quality through Critique
June 10, 2021
"The next big thing will be knowledge management powered by new no-code and integrative tools."
Deanna Washington Bria Alexander Jon Fukuda Saara Kamppari-Miller Farid SabitovConnecting the Ops: Plenary Panel and Closing Circle
September 9, 2022
"The equity executive order calls for a whole-of-government transformation—think about the scale of that."
Aaron Stienstra Lashanda HodgeLeveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government
December 8, 2021
