Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Dark Side of Democratization

Friday, October 13, 2023 • Advancing Research Community
Share the love for this talk
Dark Side of Democratization
Speakers: Ari Zelmanow
Link:

Summary

The democratization of research practices has become almost ubiquitous, and an increasingly expanding part of many research teams. There has been a lot of discussion and sharing about the benefits of democratization programs, and case studies shared on how to make them effectively work. As the reach of this approach grows though, there are a number of emerging voices who are starting to question the way in which democratization programs are being used and rolled out. As well as asking difficult questions about the extent to which they should be deployed in the first place, and how they are able to work, rather than undermine, traditional research sciences.

Key Insights

  • The term 'democratization' in research is often misleading and functions as propaganda framing critics negatively.

  • Research involves three phases: impartial evidence collection, partial insight generation, and case presentation with a point of view.

  • Good enough research is often not actually good enough; the risks of poor-quality research can undermine business decisions.

  • The Dunning-Kruger effect leads untrained non-researchers to overestimate their research competence.

  • Democratization without guardrails creates a 'wild west' in organizations where research quality and ethics suffer.

  • Researchers have specialized training akin to physicians or detectives, which cannot be casually transferred.

  • Well-designed democratization programs require explicit governance, training, coaching, and clear boundaries on what non-experts can do.

  • Making insights ubiquitous and accessible across the business is more beneficial than broadly democratizing research tasks.

  • Research value lies more in developing informed points of view and strategic decision support than in merely delivering data or reports.

  • The research profession struggles with balancing rigor and protecting the domain without resorting to excessive gatekeeping.

Notable Quotes

"The very word democratization in research is misleading, almost akin to propaganda."

"Good enough research? Sometimes good enough isn’t good enough."

"Who would you rather have conduct heart surgery? A part-time or full-time surgeon? That’s specialization."

"The risk of using bad data is worse than using no data."

"There are no guardrails in democratization, and that is dangerous."

"Researchers are like detectives. We turn data into stories, stories into strategy, strategy into outcome."

"Overconfidence is a problem caused by the Dunning-Kruger effect in research democratization."

"Making insights ubiquitous is different from allowing anyone to do research."

"Businesses don’t democratize functions like finance or engineering; why research?"

"Our value as researchers is the diversity of thought and experience to develop a point of view."

Ask the Rosenbot
Amy Evans
How to Create Change
2024 • DesignOps Summit 2024
Gold
Jemma Ahmed
Theme Three Intro
2023 • Advancing Research 2023
Gold
Ariel Kennan
Theme Two Intro
2022 • Civic Design 2022
Gold
Alnie Figueroa
Teamwork: Strategies for Effective Collaboration with Other Program Management Teams
2022 • DesignOps Summit 2022
Gold
Michaela Mora
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
2022 • Advancing Research 2022
Gold
Brad Peters
Short Take #1: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Erin Weigel
Testing and Experimentation Tools
2026 • Advancing Research 2026
Gold
Indi Young
Thinking styles: Mend hidden cracks in your market
2025 • Rosenfeld Community
Aditi Ruiz
A PM State of Mind: Empathy Mapping Your Product Manager, Pt. 1
2022 • Design in Product 2022
Gold
Mariesa Lenz
What Beekeeping Taught me about Product Teams
2025 • Rosenfeld Community
Sean Baker
Weaving Knowledge Management into the Fabric of Our Design Practice
2025 • DesignOps Summit 2025
Gold
JP Allen
Navigating the UX Tool Landscape
2021 • Advancing Research 2021
Gold
Ana Ferreira
Designing Distributed: Leading Doist’s Fully Remote Design Team in Six Countries
2024 • DesignOps Summit 2020
Gold
Yalenka Mariën
Designing for Digital Inclusion in the Belgian Government
2021 • Civic Design 2021
Gold
Jilanna Wilson
Distributed DesignOps Management
2019 • DesignOps Community
Ariel Kennan
Theme 2 Intro
2021 • Civic Design 2021
Gold

More Videos

Sheri Byrne-Haber

"You’re not supposed to sell to the US public sector unless you’re WCAG 2.0 AA compliant."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Prayag Narula

"Observation reveals needs users themselves haven’t recognized yet."

Prayag Narula Hannah Hudson

Empowering Designers to do Good Research

March 11, 2022

Janelle Estes

"Companies had to relearn their customers during COVID because behavior had fundamentally changed."

Janelle Estes

UX Research Trends

January 28, 2021

Craig Brookes

"Style guides and embedding content systems into design systems help scale content without bottlenecks."

Craig Brookes Andreas Huebner Morgan Quinn

"Just Make it Look Good" and Other Ways We're Misunderstood

June 11, 2021

Marc Fonteijn

"The community is an ongoing prototype; members have a strong, frequent voice in shaping what good looks like."

Marc Fonteijn Ru Butler

Increase your confidence, influence, and impact (through a Professional Community)

December 3, 2024

Kate Towsey

"The issue is not research ops being more organized researchers — the problems and scale are very different."

Kate Towsey

The State of ResearchOps: More Than Just Theory

June 20, 2019

Alla Weinberg

"Sometimes the entire leadership team quitting at once is a big sign cultural safety is failing."

Alla Weinberg

Design Teams Need Psychological Safety: Here’s How to Create It

September 9, 2022

Shawna Hein

"Our digital experience group acts like hosts and planners making sure veterans sit down to a cohesive, inclusive meal, not just disparate dishes."

Shawna Hein Kevin Hoffman

Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts

November 17, 2022

Tricia Wang

"You need to build credibility. It's not enough to just state a problem, you have to show you'll do the work and push for it."

Tricia Wang

SCALE: Discussion

June 15, 2018