Right horses for the right courses – how and when to democratize research
Summary
“Research democratization” has become a rallying cry in many organizations — but also a source of tension. Should everyone be able to run studies, or should research stay tightly centralized? The truth is, both extremes create waste, confusion, and risk. In this talk, I’ll share a practical framework for when to democratize and when to centralize research. You’ll learn how to weigh risk, reversibility, and audience impact; how to put guardrails around democratized research; and how AI can enable broader participation without chaos. You’ll leave with a decision matrix and a “democratization charter” you can adapt to your org, so the right people are on the right horses for the right courses.
Key Insights
-
•
Democratization of research exists on a spectrum and must be customized to each organization's context, risk tolerance, and regulatory environment.
-
•
Not all research tasks should be democratized; high-risk or unclear problems require specialist researcher involvement.
-
•
AI tools are enabling broader roles for PMs and designers, allowing faster prototyping and product documentation, blurring specialist boundaries.
-
•
Effective democratization requires elegant guardrails to protect participant safety, data privacy, and research quality.
-
•
Democratization can massively increase organizational research capacity, as Flight Center’s example shows, tripling volume while maintaining quality.
-
•
Training and certification are critical to enable non-researchers to run low-risk studies effectively and ethically.
-
•
Bias awareness and anti-bias training are essential components of democratization to maintain the integrity of insights.
-
•
A democratization charter outlining who can conduct research, with which audiences and methods, helps set clear expectations and governance.
-
•
Research maturity assessment helps determine an organization's readiness for democratization and identifies needed upskilling.
-
•
Research quality control currently relies on script review and coaching but is evolving toward AI-supported automatic quality feedback.
Notable Quotes
"Democratization is here to stay, and it’s a positive force for good in product development."
"The democratization spectrum ranges from everyone accessing feedback to a free-for-all, but I don’t advocate for a free-for-all."
"We need elegant guardrails to keep the business safe, keep participants safe, and make democratization ethical."
"Flight Center went from 10 researchers running research to over 130 people trained to safely do interviews."
"When done right, democratization multiplies the impact of research rather than diluting it."
"The goal is to lower the floor for who can access research while raising the ceiling of what’s possible."
"It should be as easy to run research as brushing your teeth."
"AI will soon enable us to automatically flag leading questions and coach researchers for quality."
"Not every problem needs research; sometimes it’s fine to ship quickly and learn after."
"Training non-researchers in bias awareness and methodology is essential to prevent poor data and insights."
Or choose a question:
More Videos
"AI won’t transform all things at once; it’s about piloting and delivering discrete business value first."
Jon Fukuda Amy Evans Ignacio Martinez Joe MeersmanThe Big Question about Innovation: A Panel Discussion
September 25, 2024
"Accessibility is not a shackle; it’s a way to expand our minds and innovate."
Sam ProulxAccessibility: An Opportunity to Innovate
March 9, 2022
"Diversity means who is in the room, equity asks who wants to or should be in the room but isn’t, and inclusion asks have everybody’s ideas been heard."
Anna Avrekh Amy Jiménez Márquez Morgan C. Ramsey Catarina TsangDiversity In and For Design: Building Conscious Diversity in Design and Research
June 9, 2021
"Context retention is tough; Siri and Google Assistant completely lose prior contexts after one action."
Greg NudelmanDesigning Conversational Interfaces
November 14, 2019
"You get real coded components, not just HTML snippets or style attributes, meaning developers can drag, drop, and extend with hooks already in place."
George Abraham Stefan IvanovDesign Systems To-Go: Reimagining Developer Handoff, and Introducing App Builder (Part 2)
October 1, 2021
"Private mode in Miro lets you get the most variety of input by making contributions anonymous."
Shipra KayanMake your research synthesis speedy and more collaborative using a canvas
January 24, 2025
"Accessibility is not just one person’s responsibility; it must be distributed through the whole product team."
Sam ProulxDesigning For Screen Readers: Understanding the Mental Models and Techniques of Real Users
December 10, 2021
"The rebrand caused our NPS to plummet and freaked out our executives — that was the trigger to get serious."
Shipra KayanHow we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
September 30, 2021
"You don’t need special software to get started analyzing gestures and embodied actions; you just need video and a notepad."
Dane DeSutterKeeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
March 26, 2024
