Rosenverse
Learning Velocity—The Insights Speedometer

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Learning Velocity—The Insights Speedometer

Thursday, September 16, 2021 • Advancing Research Community
Share the love for this talk
Learning Velocity—The Insights Speedometer
Speakers: Jen Cardello and Jennifer Otto
Link:

Summary

Measuring the success of research efforts is a critical capability in maturing our discipline and increasing our influence. This Advancing Research call is an opportunity to hear about “learning velocity,” how it’s being applied at Fidelity Investments, and what that could mean for you. Fidelity’s Jen Cardello, head of UX Research & Insights, and Jen Otto, head of Research Operations, shares how learning velocity has become a significant outcome that drives both ResearchOps initiatives (e.g., democratization) and the way they conduct and measure the effectiveness of research at Fidelity. Jen and Jen outline what learning velocity is and how it fits into Fidelity’s outcomes-based approach to research strategy.

Key Insights

  • Fidelity's UX research team faced huge scale challenges with 600+ product teams and only 35 researchers, making ubiquity impossible.

  • Focusing on research quantity, such as more studies faster, is counterproductive and considered poison; instead, learning velocity is the priority.

  • The democratization program trained over 200 designers and product partners to independently run unmoderated usability tests, cutting insight turnaround from 14 days to 3 days.

  • Quality control in democratization was ensured via a buddy system and approval gating in the testing platform to maintain high research standards.

  • Lighthouse centralized all UX research insights with strict standards on metadata and titling to reduce redundancy and make insights easily discoverable.

  • Lighthouse integration with collaboration tools like Microsoft Teams encouraged organic sharing and started building insight virality and empathy culture.

  • Continuous Discovery and Feedback (CDF) introduced a steady sprint cadence with dedicated researchers per initiative, aligned to living learning agendas prioritizing research questions.

  • CDF enabled transparency and cross-team collaboration, letting teams track when questions were posed and answered, speeding prioritization and strategic alignment.

  • Rapid recruiting innovations, including app push notifications and online scheduling, transformed a 4-6 week participant recruitment process down to hours or days.

  • Cultural acceptance was crucial; designers embraced democratization for autonomy and faster validation, while researchers accepted a shift from execution to facilitation roles.

Notable Quotes

"We cannot be everywhere. So is the goal to conduct more studies faster? And we said no, it’s not. That’s poison."

"The focus is on helping the organization learn faster to make smart, human-centered decisions."

"We had a backlog that made turnaround times at least 14 days; now teams can get answers within three days through democratization."

"Lighthouse reduces time spent searching for insights by having everything in one place."

"Democratization is about letting go of some research and enabling teams to learn from customers directly."

"The buddy system ensures quality by requiring study review and approval before launching."

"Continuous Discovery runs every two to three weeks with dedicated researchers tied to specific product journeys."

"Recruiting used to take 4 to 6 weeks; now, with app push notifications, we can fill interviews within an hour and a half."

"Designers want to learn how to do research because they get autonomy and faster feedback, not just waiting weeks."

"We shifted from an output mindset of how much work we do to an outcome mindset of the impact our work delivers."

Ask the Rosenbot
Christian Bason
Innovating With People: Unleashing the Potential of Civic Design
2021 • Civic Design 2021
Gold
Deirdre Hirschtritt
Research is Only as Good as the Relationships You Build
2022 • Civic Design 2022
Gold
Prayag Narula
Empowering Designers to do Good Research
2022 • Advancing Research 2022
Gold
Alana Washington
(Remote) Service Design: A Transformation Case Study
2022 • Design at Scale 2022
Gold
James Chudley
Decarbonising User Journeys: How minimising enables us to do more with less
2025 • Climate UX Interest Group
Steve Turbek
Designing Interactive Graphics with AI Code Help
2026 • Rosenfeld Community
James Rampton
The Basics of Automotive UX & Why Phones Are a Part of That Future
2024 • Rosenfeld Community
Clemens Janssen
Efficiently Scaling Research as a Team of One
2023 • Advancing Research 2023
Gold
Victor Lombardi
Bridging Design and Climate Science
2024 • Climate UX Interest Group
Catherine Courage
The Enterprise UX Journey: Lessons From the Voyage & The Opportunity Ahead
2015 • Enterprise UX 2015
Gold
Marina Martin
Lives on the Line: The Stakes of UX at the Scale of Government
2018 • Enterprise Experience 2018
Gold
Elena Naids
The Power of Difficult Conversations: A Case Study on How We Introduced Design Ops in the Federal Government Space
2023 • DesignOps Summit 2023
Gold
Lavy Kumar
Future of Work
2021 • Design at Scale 2021
Gold
Bria Alexander
Welcome
2022 • DesignOps Summit 2022
Gold
Cheryl Platz
Merging Improv with Design
2019 • Enterprise Community
Michael Weir
Mixed Methods and Behavioural Science
2023 • Rosenfeld Community

More Videos

Alexia Cohen

"We decided with the COP to view our budget as a moral document."

Alexia Cohen Adriane Ackerman

Increasing Health Equity and Improving the Service Experience for Under-Served Latine Communities in Arizona

December 4, 2024

Marc Majers

"You want to separate out those distractions from the actual tasks."

Marc Majers Tony Turner

Interrupted UX - Add A Dose of Reality To Usability Testing

March 11, 2022

Jorge Arango

"Language itself can be a powerful design object, shaping social roles and organizational interactions."

Jorge Arango

Design as an Antidote to VUCA

May 9, 2019

Brenna Fallon

"If you get a perfect OKR score, it means you didn’t set your sights high enough."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Daniel Gloyd

"You could lift their famous ladder back chair with just your pinky finger—it’s exquisitely designed with minimal material."

Daniel Gloyd

Warming the User Experience: Lessons from America's first and most radical human-centered designers

May 9, 2024

Sam Proulx

"Confidence is critical in online shopping because nobody wants to spend money they’re unsure about losing due to unclear controls."

Sam Proulx

Online Shopping: Designing an Accessible Experience

October 3, 2023

Kristin Skinner

"Personalization is not just a trend; it’s a necessity."

Kristin Skinner

Five Years of DesignOps

September 29, 2021

Denise Jacobs

"Racism is by design, and there's no way to counter it unless we counter it with design."

Denise Jacobs Nancy Douyon Renee Reid Lisa Welchman

Interactive Keynote: Social Change by Design

January 8, 2024

Roberta Dombrowski

"Keeping communication fluid with participants until the moderated session keeps them engaged and less likely to forget."

Roberta Dombrowski Lianna Aduana

5 Reasons to Bring your Recruiting in House

September 30, 2021