Rosenverse
Learning Velocity—The Insights Speedometer

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Learning Velocity—The Insights Speedometer

Thursday, September 16, 2021 • Advancing Research Community
Share the love for this talk
Learning Velocity—The Insights Speedometer
Speakers: Jen Cardello and Jennifer Otto
Link:

Summary

Measuring the success of research efforts is a critical capability in maturing our discipline and increasing our influence. This Advancing Research call is an opportunity to hear about “learning velocity,” how it’s being applied at Fidelity Investments, and what that could mean for you. Fidelity’s Jen Cardello, head of UX Research & Insights, and Jen Otto, head of Research Operations, shares how learning velocity has become a significant outcome that drives both ResearchOps initiatives (e.g., democratization) and the way they conduct and measure the effectiveness of research at Fidelity. Jen and Jen outline what learning velocity is and how it fits into Fidelity’s outcomes-based approach to research strategy.



Key Insights

  • •

    Fidelity's UX research team faced huge scale challenges with 600+ product teams and only 35 researchers, making ubiquity impossible.

  • •

    Focusing on research quantity, such as more studies faster, is counterproductive and considered poison; instead, learning velocity is the priority.

  • •

    The democratization program trained over 200 designers and product partners to independently run unmoderated usability tests, cutting insight turnaround from 14 days to 3 days.

  • •

    Quality control in democratization was ensured via a buddy system and approval gating in the testing platform to maintain high research standards.

  • •

    Lighthouse centralized all UX research insights with strict standards on metadata and titling to reduce redundancy and make insights easily discoverable.

  • •

    Lighthouse integration with collaboration tools like Microsoft Teams encouraged organic sharing and started building insight virality and empathy culture.

  • •

    Continuous Discovery and Feedback (CDF) introduced a steady sprint cadence with dedicated researchers per initiative, aligned to living learning agendas prioritizing research questions.

  • •

    CDF enabled transparency and cross-team collaboration, letting teams track when questions were posed and answered, speeding prioritization and strategic alignment.

  • •

    Rapid recruiting innovations, including app push notifications and online scheduling, transformed a 4-6 week participant recruitment process down to hours or days.

  • •

    Cultural acceptance was crucial; designers embraced democratization for autonomy and faster validation, while researchers accepted a shift from execution to facilitation roles.

Notable Quotes

"We cannot be everywhere. So is the goal to conduct more studies faster? And we said no, it’s not. That’s poison."

"The focus is on helping the organization learn faster to make smart, human-centered decisions."

"We had a backlog that made turnaround times at least 14 days; now teams can get answers within three days through democratization."

"Lighthouse reduces time spent searching for insights by having everything in one place."

"Democratization is about letting go of some research and enabling teams to learn from customers directly."

"The buddy system ensures quality by requiring study review and approval before launching."

"Continuous Discovery runs every two to three weeks with dedicated researchers tied to specific product journeys."

"Recruiting used to take 4 to 6 weeks; now, with app push notifications, we can fill interviews within an hour and a half."

"Designers want to learn how to do research because they get autonomy and faster feedback, not just waiting weeks."

"We shifted from an output mindset of how much work we do to an outcome mindset of the impact our work delivers."

Ask the Rosenbot
Amy Evans
How to Create Change
2024 • DesignOps Summit 2024
Gold
Dave Malouf
Theme 3: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
Jess Greco
Creating a Basis for Change: Scaling Design Maturity
2022 • Design at Scale 2022
Gold
JP Allen
Navigating the UX Tool Landscape
2021 • Advancing Research 2021
Gold
Lena Shenkarenko
Collaborative Wireframing for Creating Team Alignment and Shipping Better Products
2020 • DesignOps Summit 2020
Gold
Sean McKay
Whole Product Thinking: Expanding beyond problem and solution space thinking
2024 • Rosenfeld Community
Rob Mitzel
The Tale of Two Companies: Building a Successful UX Practice in a Century-Old Enterprise
2024 • Enterprise Experience 2020
Gold
Sarah Williams
Verizon_A Framework for CX Transformation
2024 • Design at Scale 2021
Gold
Taylor Klassman
The Evolution of UX Research Platforms
2026 • Advancing Research 2026
Gold
Dr. Karl Jeffries
The Science of Creativity for DesignOps
2024 • DesignOps Summit 2020
Gold
Chelsey Glasson
Exit Interview #3: Same as It Ever Was: What Leaving Tech Taught Me About Change
2025 • Rosenfeld Community
Alexandra Schmidt
Why Ethics Can't Save Tech
2022 • Civic Design 2022
Gold
Eniola Oluwole
Lessons From the DesignOps Journey of the World's Largest Travel Site
2019 • DesignOps Summit 2019
Gold
Richard Buchanan
Creativity and Principles in the Flourishing Enterprise
2018 • Enterprise Experience 2018
Gold
Meredith Black
Scaling Design Culture
2017 • DesignOps Summit 2017
Gold
Leah Buley
Ask Me Anything with Leah Buley and Joe Natoli, co-authors of The User Experience Team of One (2nd edition)
2024 • Rosenfeld Community

More Videos

Mark Interrante

"Many organizations silo data inputs and prioritize within categories before combining results."

Mark Interrante Harry Max

AI for Prioritization (3rd of 3 seminars)

July 11, 2024

Patrizia Bertini

"Compliance is everyone's concern but no one's responsibility."

Patrizia Bertini

The (r)evolution of designOps: It’s Time to Think (really) BIG

September 11, 2025

Shan Shen

"Start small, try to learn as you go, and set realistic expectations to avoid being humbled when things go live."

Shan Shen

Translating UX Terms into Business Contexts

November 29, 2023

Adam Thomas

"Everyone has a plan until they get punched in the mouth, said Mike Tyson."

Adam Thomas

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

December 6, 2022

Robin Beers

"We’re still operating from an industrial era hangover — a mechanistic way of problem solving that doesn’t fit today’s complexity."

Robin Beers

Research as a Catalyst for Organizational Transformation

March 12, 2021

Sheri Byrne-Haber

"Accessibility defects are bugs. If it’s a P1 blocking bug for an accessibility issue, treat it like any other P1 bug."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Joseph Meersman

"Designers are uniquely entitled to critique—it’s a privilege to rigorously improve craft while others might envy that process."

Joseph Meersman

Sweating the Pixel: Scaling Quality through Critique

June 10, 2021

Deanna Washington

"Make a business case for yourself by bragging about your capabilities and making them applicable."

Deanna Washington Bria Alexander Jon Fukuda Saara Kamppari-Miller Farid Sabitov

Connecting the Ops: Plenary Panel and Closing Circle

September 9, 2022

Aaron Stienstra

"The equity executive order calls for a whole-of-government transformation—think about the scale of that."

Aaron Stienstra Lashanda Hodge

Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government

December 8, 2021