Right horses for the right courses – how and when to democratize research
Summary
In this talk, I’ll share a practical framework for when to democratize and when to centralize research. You’ll learn how to weigh risk, reversibility, and audience impact; how to put guardrails around democratized research; and how AI can enable broader participation without chaos. You’ll leave with a decision matrix and a “democratization charter” you can adapt to your org, so the right people are on the right horses for the right courses.
Key Insights
-
•
Democratization of research exists on a spectrum and must be customized to each organization's context, risk tolerance, and regulatory environment.
-
•
Not all research tasks should be democratized; high-risk or unclear problems require specialist researcher involvement.
-
•
AI tools are enabling broader roles for PMs and designers, allowing faster prototyping and product documentation, blurring specialist boundaries.
-
•
Effective democratization requires elegant guardrails to protect participant safety, data privacy, and research quality.
-
•
Democratization can massively increase organizational research capacity, as Flight Center’s example shows, tripling volume while maintaining quality.
-
•
Training and certification are critical to enable non-researchers to run low-risk studies effectively and ethically.
-
•
Bias awareness and anti-bias training are essential components of democratization to maintain the integrity of insights.
-
•
A democratization charter outlining who can conduct research, with which audiences and methods, helps set clear expectations and governance.
-
•
Research maturity assessment helps determine an organization's readiness for democratization and identifies needed upskilling.
-
•
Research quality control currently relies on script review and coaching but is evolving toward AI-supported automatic quality feedback.
Notable Quotes
"Democratization is here to stay, and it’s a positive force for good in product development."
"The democratization spectrum ranges from everyone accessing feedback to a free-for-all, but I don’t advocate for a free-for-all."
"We need elegant guardrails to keep the business safe, keep participants safe, and make democratization ethical."
"Flight Center went from 10 researchers running research to over 130 people trained to safely do interviews."
"When done right, democratization multiplies the impact of research rather than diluting it."
"The goal is to lower the floor for who can access research while raising the ceiling of what’s possible."
"It should be as easy to run research as brushing your teeth."
"AI will soon enable us to automatically flag leading questions and coach researchers for quality."
"Not every problem needs research; sometimes it’s fine to ship quickly and learn after."
"Training non-researchers in bias awareness and methodology is essential to prevent poor data and insights."
Or choose a question:
More Videos
"There are roles out there, but they come with longer processes—some of mine lasted up to five months."
Corey LongHiring in DesignOps: A Critical Study on How to Hire and Get Hired
September 23, 2024
"Pair design is about two perspectives coming together as peers to quickly try and evaluate ideas."
Gretchen AndersonScaling the Human Center
June 8, 2017
"We create the constraints that bring out the best from design teams. We are the enablers of weird."
Lori Muszynski Peter MerholzKeeping Design Weird
October 2, 2023
"Alternative navigation users might use voice commands, head mice, or grid coordinates to access elements."
Sam ProulxSUS: A System Unusable for Twenty Percent of the Population
June 9, 2021
"Drivers continued the practice of hanging out in physical base camp spots despite platforms saying they wanted to get rid of them."
Prayag Narula Rida QadriHCI 2.0: Humanity Deserves the Attention that UX Research has to Offer
March 28, 2023
"We forget a lot of details over time; documentation saves us from repeating mistakes."
Deanna SmithLeading Change with Confidence: Strategies for Optimizing Your Process
September 23, 2024
"You really have to be honest about whether your organization is ready to democratize research."
Lija HoganDoing more with more: Lessons from the Front Lines of Democratization
March 9, 2022
"The Apple 3GS and the accessibility that was developed by Apple was a massive shift."
Sam ProulxTo Boldly Go: The New Frontiers of Accessibility
March 11, 2022
"If you feel uncomfortable or bullied, please let us know because it’s very important to keep the vibes positive."
Bria AlexanderOpening Remarks
October 3, 2023
