Rosenverse
The Five Dysfunctions of Democratized Research at Scale

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

The Five Dysfunctions of Democratized Research at Scale

Gold
Monday, March 30, 2020 • Advancing Research 2020
Share the love for this talk
The Five Dysfunctions of Democratized Research at Scale
Speakers: Leisa Reichelt
Link:

Summary

As more organizations embrace research we move on to the second generation question – how do we scale this user centered behavior to support demand? There are fairly systemic issues that can undermine our best intentions. At best, it can render our research wasteful and inefficient, and at worst it can introduce significant risks in the decision making that our teams make. This talk considers five of the most likely challenges you’ll rub up against – speed, silos, teams, numbers and failure to mature. We’ll then discuss what causes these and what you can do to mitigate risks for your organization.

Key Insights

  • •

    Democratizing research is more than encouraging everyone to talk to customers; it requires activating existing team tools thoughtfully.

  • •

    There are two distinct jobs in customer research: building empathy for diverse contexts and gathering evidence to validate decisions.

  • •

    Speed pressure often leads teams to cut corners in participant recruitment and data analysis, risking biased and invalid research.

  • •

    Silo dysfunction arises when teams focus narrowly on their feature without considering the broader user context, increasing false positives.

  • •

    Weaponizing research happens when teams use data combatively in internal disputes rather than as a tool for collaboration and understanding.

  • •

    Quantitative data is often privileged because numbers are easier to digest, but mixed methods that combine qualitative insights yield richer results.

  • •

    Early-stage usability testing with just one user can be beneficial to get started, but should not be the permanent approach for mature teams.

  • •

    Risk management framing helps match research effort to the potential impact of decisions, optimizing resource use.

  • •

    Involving product managers, designers, and engineers together in quality conversations enhances shared understanding and decision making.

  • •

    Focusing on end-to-end user journeys rather than isolated features helps teams avoid narrow perspectives and create better product experiences.

Notable Quotes

"More people being closer to customers is very likely to help us achieve better products and services."

"Speed matters, but saving time in recruitment and analysis can lead to invalid and biased research."

"A developer pretending to be a product manager is not reliable participant data."

"People can make up an opinion about anything if asked, which leads to the query effect."

"False positives in research give teams misleading evidence that their solutions are working."

"Designers are not trusted unless they bring data to the table."

"Research should reduce the risk of investing in the wrong place or in the wrong way."

"Testing one user is 100 percent better than testing none, but it’s not a strategy forever."

"Qualitative research gives us the richer, more nuanced and complex conversations."

"Product managers ultimately make the call about research investments and prioritization."

Ask the Rosenbot
Melinda Belcher
Insider preview of Enterprise Experience 2020
2020 • Enterprise Community
Yalenka Mariën
Designing for Digital Inclusion in the Belgian Government
2021 • Civic Design 2021
Gold
Erin Weigel
UX Lessons from running more than 1,200 A/B Tests
2024 • Rosenfeld Community
Zariah Cameron
Streamlining an Inclusive Design Practice
2023 • DesignOps Summit 2023
Gold
Mujtaba Hameed
The new horizon of ethnography: using AI to unlock the full potential of in-person research
2026 • Advancing Research 2026
Gold
Stephen Pollard
Closing Keynote: Getting giants to dance - what can we learn from designing large and complex public infrastructure?
2017 • DesignOps Summit 2017
Gold
Eniola Oluwole
Lessons From the DesignOps Journey of the World's Largest Travel Site
2019 • DesignOps Summit 2019
Gold
Saara Kamppari-Miller
Inclusive Design is DesignOps
2021 • DesignOps Summit 2021
Gold
Sean McKay
Coexisting with non-researchers: Practical strategies for a democratized research future
2025 • Advancing Research 2025
Gold
Devon Powers
Imagining Better Futures
2022 • Advancing Research 2022
Gold
Laura Klein
Unique challenges of innovation in enterprises
2020 • Enterprise Community
Cheryl Platz
Collaborative Creativity through Improv
2018 • DesignOps Summit 2018
Gold
Tamara Hale
War Stories LIVE! Tamara Hale
2020 • Advancing Research 2020
Gold
Randolph Duke II
War Stories LIVE! Randy Duke II
2020 • Advancing Research 2020
Gold
Sarah Fathallah
Lessening the Research Burden on Vulnerable Communities
2020 • Advancing Research 2020
Gold
Joshua Noble
Casual Inference
2023 • QuantQual Interest Group

More Videos

Marc Fonteijn

"We encourage one-to-one video calls to build rapport and feel comfortable reaching out for advice."

Marc Fonteijn Ru Butler

Increase your confidence, influence, and impact (through a Professional Community)

December 3, 2024

Dem Gerolemou

"No one wants to use a calendar; they want to be organized. Protect users from having to engage with complexity."

Dem Gerolemou Alexis Oh Neef Rehman

Climate technology fundamentals

May 15, 2024

Daniela Magaña Flores

"We offer a quantitative approach so you can quickly recognize the strengths and weaknesses in a product compared to competitors."

Daniela Magaña Flores Ariane Rahn Jeff Ephraim Bander

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

March 10, 2022

Abbey Smalley

"I met with my partners and leaders to really dig into their hopes, fears, and dreams about where they wanted to go."

Abbey Smalley Sylas Souza

Scaling UX Past the Size of Your Team

January 8, 2024

Patrick Commarford

"If you’re like us, you’d love to have 100% of the UX talent every project needs, but your team isn’t large enough."

Patrick Commarford

Design Staffing for Impact

January 8, 2024

Xenia Adjoubei

"We mapped every individual journey on Google Earth attaching quotations and photographs to each location to represent human experiences."

Xenia Adjoubei Sean Bruce

Empowering Communities Through the Researcher in Residence Program

March 29, 2023

Craig Villamor

"Designers need to speak truth to power and engage their creative abilities to materially change how and what is produced."

Craig Villamor

Design Systems for Ethical Design

January 26, 2023

Jon Fukuda

"Fostering a culture of use and leadership is essential to make these tools part of daily rituals."

Jon Fukuda Ellie Krysl

Design Planning and Management Support

October 3, 2023

Iain McMaster

"31% say design just executes product’s vision, 48% say product and design have different visions, only 21% say they work together towards shared goals."

Iain McMaster IHan Cheng

Design and Product: from Frenemy to Harmony

November 29, 2023