Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Dark Side of Democratization

Friday, October 13, 2023 • Advancing Research Community
Share the love for this talk
Dark Side of Democratization
Speakers: Ari Zelmanow
Link:

Summary

The democratization of research practices has become almost ubiquitous, and an increasingly expanding part of many research teams. There has been a lot of discussion and sharing about the benefits of democratization programs, and case studies shared on how to make them effectively work. As the reach of this approach grows though, there are a number of emerging voices who are starting to question the way in which democratization programs are being used and rolled out. As well as asking difficult questions about the extent to which they should be deployed in the first place, and how they are able to work, rather than undermine, traditional research sciences.

Key Insights

  • The term 'democratization' in research is often misleading and functions as propaganda framing critics negatively.

  • Research involves three phases: impartial evidence collection, partial insight generation, and case presentation with a point of view.

  • Good enough research is often not actually good enough; the risks of poor-quality research can undermine business decisions.

  • The Dunning-Kruger effect leads untrained non-researchers to overestimate their research competence.

  • Democratization without guardrails creates a 'wild west' in organizations where research quality and ethics suffer.

  • Researchers have specialized training akin to physicians or detectives, which cannot be casually transferred.

  • Well-designed democratization programs require explicit governance, training, coaching, and clear boundaries on what non-experts can do.

  • Making insights ubiquitous and accessible across the business is more beneficial than broadly democratizing research tasks.

  • Research value lies more in developing informed points of view and strategic decision support than in merely delivering data or reports.

  • The research profession struggles with balancing rigor and protecting the domain without resorting to excessive gatekeeping.

Notable Quotes

"The very word democratization in research is misleading, almost akin to propaganda."

"Good enough research? Sometimes good enough isn’t good enough."

"Who would you rather have conduct heart surgery? A part-time or full-time surgeon? That’s specialization."

"The risk of using bad data is worse than using no data."

"There are no guardrails in democratization, and that is dangerous."

"Researchers are like detectives. We turn data into stories, stories into strategy, strategy into outcome."

"Overconfidence is a problem caused by the Dunning-Kruger effect in research democratization."

"Making insights ubiquitous is different from allowing anyone to do research."

"Businesses don’t democratize functions like finance or engineering; why research?"

"Our value as researchers is the diversity of thought and experience to develop a point of view."

Ask the Rosenbot
Louis Rosenfeld
Welcome / Housekeeping
2023 • Enterprise UX 2023
Gold
Daniel J. Rosenberg
Digital Medicine Design
2019 • Enterprise Community
Mackenzie Guinon
M.C. Escher’s UX Research Career Ladder
2022 • Advancing Research 2022
Gold
Alla Weinberg
Design Teams Need Psychological Safety: Here’s How to Create It
2022 • DesignOps Summit 2022
Gold
Laura Klein
Human vs. machine: Testing AI’s ability to synthesize and analyze research
2026 • Advancing Research 2026
Conference
Savina Hawkins
Harnessing AI in UXR: Practical Strategies for Positive Impact
2024 • Advancing Research 2024
Gold
Erika Flowers
Introduction to MURAL for UX
2021 • Design at Scale 2021
Gold
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • DesignOps Summit 2023
Gold
Ian Johnson
Latent Scope: Finding structure in unstructured data
2025 • Designing with AI 2025
Gold
Sarah Auslander
Incremental Steps to Drive Radical Innovation in Policy Design
2022 • Civic Design 2022
Gold
Courtney Maya George
Scale Your Organization and Grow Your Designers
2022 • DesignOps Summit 2022
Gold
Tara Tressel
Investigating qualitative depth of AI-moderated interviews
2026 • Advancing Research 2026
Conference
Lukas Moro
“Feels Like Paper!”: Interfacing AI through Paper
2025 • Designing with AI 2025
Gold
Uday Gajendar
10 Years of Enterprise UX: Reflecting on the community and the practice
2025 • Enterprise Community
Alana Washington
(Remote) Service Design: A Transformation Case Study
2022 • Design at Scale 2022
Gold
Jon White
Unsticking Research for Better Information Flow
2026 • Advancing Research 2026
Conference

More Videos

Sam Proulx

"Testing with the tab key is important, but it has nothing to do with a screen reader user’s actual experience."

Sam Proulx

Everything You Ever Wanted to Know About Screen Readers

June 11, 2021

Bria Alexander

"If you are a cohort participant and don’t see your private Slack channel, please let us know so we can guide you."

Bria Alexander

Opening Remarks

November 17, 2022

Corey Nelson

"Layoffs are a collective trauma – it’s okay to acknowledge the emotions and grief you feel."

Corey Nelson Amy Santee

Layoffs

November 15, 2022

Milan Guenther

"Designing better enterprises means creating conditions for all parts to work together coherently, like gardening rather than blaming individual plants."

Milan Guenther

A Shared Language for Co-Creating Ambitious Endeavours

June 6, 2023

Erin May

"75% of democratized studies don’t see full reporting mostly because stakeholders don’t have time for the analysis."

Erin May Roberta Dombrowski Laura Oxenfeld Brooke Hinton

Distributed, Democratized, Decentralized: Finding a Research Model to Support Your Org

March 10, 2022

Sam Proulx

"If you falsely think you are having the same experience as a native user, you become afraid of accessibility and say it's impossible."

Sam Proulx

Understanding Screen Readers on Mobile: How And Why to Learn from Native Users

June 6, 2023

Mujtaba Hameed

"We experimented with AI-powered sprints, but had lots of dead ends and false starts before finding what really works for us."

Mujtaba Hameed

The new horizon of ethnography: using AI to unlock the full potential of in-person research

March 11, 2026

Ilana Lipsett

"Ethical technology governance means anticipating the long-term social impacts of technology today and acting to protect essential public goods."

Ilana Lipsett

Anticipating Risk, Regulating Tech: A Playbook for Ethical Technology Governance

December 10, 2021

Samuel Proulx

"When we build accessibility into an environment, especially if we do it subtly, it becomes the new normal."

Samuel Proulx

From Standards to Innovation: Why Inclusive Design Wins

September 10, 2025