Right horses for the right courses – how and when to democratize research
Summary
“Research democratization” has become a rallying cry in many organizations — but also a source of tension. Should everyone be able to run studies, or should research stay tightly centralized? The truth is, both extremes create waste, confusion, and risk. In this talk, I’ll share a practical framework for when to democratize and when to centralize research. You’ll learn how to weigh risk, reversibility, and audience impact; how to put guardrails around democratized research; and how AI can enable broader participation without chaos. You’ll leave with a decision matrix and a “democratization charter” you can adapt to your org, so the right people are on the right horses for the right courses.
Key Insights
-
•
Democratization of research exists on a spectrum and must be customized to each organization's context, risk tolerance, and regulatory environment.
-
•
Not all research tasks should be democratized; high-risk or unclear problems require specialist researcher involvement.
-
•
AI tools are enabling broader roles for PMs and designers, allowing faster prototyping and product documentation, blurring specialist boundaries.
-
•
Effective democratization requires elegant guardrails to protect participant safety, data privacy, and research quality.
-
•
Democratization can massively increase organizational research capacity, as Flight Center’s example shows, tripling volume while maintaining quality.
-
•
Training and certification are critical to enable non-researchers to run low-risk studies effectively and ethically.
-
•
Bias awareness and anti-bias training are essential components of democratization to maintain the integrity of insights.
-
•
A democratization charter outlining who can conduct research, with which audiences and methods, helps set clear expectations and governance.
-
•
Research maturity assessment helps determine an organization's readiness for democratization and identifies needed upskilling.
-
•
Research quality control currently relies on script review and coaching but is evolving toward AI-supported automatic quality feedback.
Notable Quotes
"Democratization is here to stay, and it’s a positive force for good in product development."
"The democratization spectrum ranges from everyone accessing feedback to a free-for-all, but I don’t advocate for a free-for-all."
"We need elegant guardrails to keep the business safe, keep participants safe, and make democratization ethical."
"Flight Center went from 10 researchers running research to over 130 people trained to safely do interviews."
"When done right, democratization multiplies the impact of research rather than diluting it."
"The goal is to lower the floor for who can access research while raising the ceiling of what’s possible."
"It should be as easy to run research as brushing your teeth."
"AI will soon enable us to automatically flag leading questions and coach researchers for quality."
"Not every problem needs research; sometimes it’s fine to ship quickly and learn after."
"Training non-researchers in bias awareness and methodology is essential to prevent poor data and insights."
Or choose a question:
More Videos
"You want to catch accessibility defects early through automated testing in your CI/CD pipeline, what we call shifting left."
Sheri Byrne-HaberAccessibility at Scale
June 9, 2021
"Data tells you what happens; qualitative research tells you why it happens."
Prayag Narula Hannah HudsonEmpowering Designers to do Good Research
March 11, 2022
"Don't just flip the switch and say go talk to customers; you have to set guardrails and train people."
Janelle EstesUX Research Trends
January 28, 2021
"Content design is nascent and often misunderstood, but embedding content designers improves product clarity and usability."
Craig Brookes Andreas Huebner Morgan Quinn"Just Make it Look Good" and Other Ways We're Misunderstood
June 11, 2021
"If you don’t feel connected and you’re standing alone, the challenge looks much bigger."
Marc Fonteijn Ru ButlerIncrease your confidence, influence, and impact (through a Professional Community)
December 3, 2024
"The longer you take to recognize research ops and scale your team, the harder it becomes to amplify the value of your research investment — Carrie, Booking.com."
Kate TowseyThe State of ResearchOps: More Than Just Theory
June 20, 2019
"Connection means feeling seen, heard, and valued; that’s what creates psychological safety."
Alla WeinbergDesign Teams Need Psychological Safety: Here’s How to Create It
September 9, 2022
"Our digital experience group acts like hosts and planners making sure veterans sit down to a cohesive, inclusive meal, not just disparate dishes."
Shawna Hein Kevin HoffmanCreate a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts
November 17, 2022
"Positive mutual regard helps uncover root causes behind people’s behaviors to build collaboration rather than combat."
Tricia WangSCALE: Discussion
June 15, 2018
