Rosenverse
But Do Your Insights Scale?

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

But Do Your Insights Scale?

Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
But Do Your Insights Scale?
Speakers: Katy Mogal
Link:

Summary

Overcoming stakeholder objections and positioning qualitative data as an input to business and product strategy. When stakeholders have access to real-time data about millions of user interactions, how can qualitative researchers articulate the value of small-sample studies for product and business strategy? In this case study, we’ll show how we used our insights chops to understand stakeholder motivations and concerns, and get qualitative research a seat at the table shaping Google Assistant’s 2020 strategy. We’ll share learnings about how human-centered researchers can effectively collaborate with functions like data science and business strategy, and how to persuade analytically-minded stakeholders to embrace rich qualitative data about people’s needs and motivations as an input to business strategy.

Key Insights

  • •

    Taking calculated risks is essential for qualitative researchers to secure influence in organization-wide strategy discussions.

  • •

    Small qualitative sample sizes can still deliver powerful impactful insights when paired with quantitative data and trust building.

  • •

    Inviting stakeholders to interact directly with unfiltered qualitative data (e.g., video diaries) fosters genuine curiosity and advocacy.

  • •

    Physicalizing data, such as printing quotes and charts in a shared workspace, promotes team engagement and collaborative sensemaking.

  • •

    Converting one respected analyst into a research evangelist can change the conversations and perceptions of entire peer groups.

  • •

    Low-stakes, incremental experiments to share insights reduce resistance and create momentum for organizational change.

  • •

    Qualitative research offers deep understanding of user motivations and needs that quantitative data alone cannot provide.

  • •

    Researchers’ empathy skills are strategic tools to understand and influence stakeholders’ fears, incentives, and motivations.

  • •

    Successful qualitative efforts depend not just on methodology rigor but on bravery, leadership, and cultural positioning.

  • •

    Embedding qualitative insights into yearly planning cycles can shift research from an add-on activity to a core strategy input.

Notable Quotes

"If they don’t give you a seat at the table, bring a folding chair."

"We decided to jump off the wall—that scary leap to prove qualitative insights can change strategy."

"The surveys and logs data tell us the what, but qualitative research tells us the why."

"One converted analyst became our research associate, and his enthusiasm was contagious."

"Getting the data out of laptops and onto the walls made the research physical and accessible."

"It’s not about the methodology, it’s about bravery and leadership."

"Find those curious partners who will evangelize the value of your insights to their peers."

"Researchers are experts at empathy and understanding motivations, which are superpowers beyond just interviewing users."

"Small experiments, planting seeds over time, can shift hearts and minds more effectively than big radical changes."

"Our insights became pillars of the 2020 product strategy and qualitative research earned a reserved seat at the table."

Ask the Rosenbot
Benjamin Wiedmaier
Redefining Toolkits: Unbundling to Create a Perfect Match
2025 • Advancing Research 2025
Gold
Vincent Brathwaite
Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams
2020 • DesignOps Summit 2020
Gold
Jack Moffett
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
2022 • Enterprise Community
Dana Chisnell
The Sensemaking Business
2026 • Advancing Research 2026
Gold
Dominique Ward
The Most Exciting Time for DesignOps is Now
2022 • DesignOps Summit 2022
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Sarah Williams
A Framework for CX Transformation
2021 • Design at Scale 2021
Gold
Abby Covert
Panel: Collaboration Tools
2017 • DesignOps Summit 2017
Gold
Samuel Proulx
From Standards to Innovation: Why Inclusive Design Wins
2025 • Advancing Service Design 2025
Gold
Louis Rosenfeld
How AI will Change DesignOps Tooling
2023 • DesignOps Summit 2023
Gold
Tanya Snook
Designing the team experience: Building culture through onboarding
2021 • Enterprise Community
Caroline Jarrett
Have fun with statistics?
2024 • Rosenfeld Community
Husani Oakley
Theme Three Intro
2023 • Enterprise UX 2023
Gold
Laura Schaefer
DesignOps: A Conduit for Inclusion
2022 • DesignOps Summit 2022
Gold
Louis Rosenfeld
Coffee with Lou #3: What Makes for a Successful UX Conference Presentation?
2024 • Rosenfeld Community
Dan Ward
Failure Friday #1 with Dan Ward
2025 • Rosenfeld Community

More Videos

Mark Interrante

"Current AI tools help summarize and sift large volumes of feedback into meaningful patterns."

Mark Interrante Harry Max

AI for Prioritization (3rd of 3 seminars)

July 11, 2024

Patrizia Bertini

"The accessibility expert was simply lost into shouting, we must be accessible without creating a strategy."

Patrizia Bertini

The (r)evolution of designOps: It’s Time to Think (really) BIG

September 11, 2025

Shan Shen

"Speaking fluent language that translates into business discussions forces us to think and speak like a business owner as well as a designer."

Shan Shen

Translating UX Terms into Business Contexts

November 29, 2023

Adam Thomas

"Stop, pivot, or invest early—these are the survival metric decisions that save companies."

Adam Thomas

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

December 6, 2022

Robin Beers

"Turning the research lens on both the ‘in here’ organization and the ‘out there’ customer reality helps reveal misalignments and opportunities."

Robin Beers

Research as a Catalyst for Organizational Transformation

March 12, 2021

Sheri Byrne-Haber

"Accessibility at scale can put you into the VUCA world – volatile, uncertain, complex, ambiguous."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Joseph Meersman

"An ad hoc critique is best when guard is down, it’s quick, time-sensitive, and helps share early to avoid costly late feedback."

Joseph Meersman

Sweating the Pixel: Scaling Quality through Critique

June 10, 2021

Deanna Washington

"The next big thing will be knowledge management powered by new no-code and integrative tools."

Deanna Washington Bria Alexander Jon Fukuda Saara Kamppari-Miller Farid Sabitov

Connecting the Ops: Plenary Panel and Closing Circle

September 9, 2022

Aaron Stienstra

"The equity executive order calls for a whole-of-government transformation—think about the scale of that."

Aaron Stienstra Lashanda Hodge

Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government

December 8, 2021