The Five Dysfunctions of Democratized Research at Scale
Summary
Key Insights
-
•
Democratizing research is more than encouraging everyone to talk to customers; it requires activating existing team tools thoughtfully.
-
•
There are two distinct jobs in customer research: building empathy for diverse contexts and gathering evidence to validate decisions.
-
•
Speed pressure often leads teams to cut corners in participant recruitment and data analysis, risking biased and invalid research.
-
•
Silo dysfunction arises when teams focus narrowly on their feature without considering the broader user context, increasing false positives.
-
•
Weaponizing research happens when teams use data combatively in internal disputes rather than as a tool for collaboration and understanding.
-
•
Quantitative data is often privileged because numbers are easier to digest, but mixed methods that combine qualitative insights yield richer results.
-
•
Early-stage usability testing with just one user can be beneficial to get started, but should not be the permanent approach for mature teams.
-
•
Risk management framing helps match research effort to the potential impact of decisions, optimizing resource use.
-
•
Involving product managers, designers, and engineers together in quality conversations enhances shared understanding and decision making.
-
•
Focusing on end-to-end user journeys rather than isolated features helps teams avoid narrow perspectives and create better product experiences.
Notable Quotes
"More people being closer to customers is very likely to help us achieve better products and services."
"Speed matters, but saving time in recruitment and analysis can lead to invalid and biased research."
"A developer pretending to be a product manager is not reliable participant data."
"People can make up an opinion about anything if asked, which leads to the query effect."
"False positives in research give teams misleading evidence that their solutions are working."
"Designers are not trusted unless they bring data to the table."
"Research should reduce the risk of investing in the wrong place or in the wrong way."
"Testing one user is 100 percent better than testing none, but it’s not a strategy forever."
"Qualitative research gives us the richer, more nuanced and complex conversations."
"Product managers ultimately make the call about research investments and prioritization."
Or choose a question:
More Videos
"We encourage one-to-one video calls to build rapport and feel comfortable reaching out for advice."
Marc Fonteijn Ru ButlerIncrease your confidence, influence, and impact (through a Professional Community)
December 3, 2024
"No one wants to use a calendar; they want to be organized. Protect users from having to engage with complexity."
Dem Gerolemou Alexis Oh Neef RehmanClimate technology fundamentals
May 15, 2024
"We offer a quantitative approach so you can quickly recognize the strengths and weaknesses in a product compared to competitors."
Daniela Magaña Flores Ariane Rahn Jeff Ephraim BanderAhead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
March 10, 2022
"I met with my partners and leaders to really dig into their hopes, fears, and dreams about where they wanted to go."
Abbey Smalley Sylas SouzaScaling UX Past the Size of Your Team
January 8, 2024
"If you’re like us, you’d love to have 100% of the UX talent every project needs, but your team isn’t large enough."
Patrick CommarfordDesign Staffing for Impact
January 8, 2024
"We mapped every individual journey on Google Earth attaching quotations and photographs to each location to represent human experiences."
Xenia Adjoubei Sean BruceEmpowering Communities Through the Researcher in Residence Program
March 29, 2023
"Designers need to speak truth to power and engage their creative abilities to materially change how and what is produced."
Craig VillamorDesign Systems for Ethical Design
January 26, 2023
"Fostering a culture of use and leadership is essential to make these tools part of daily rituals."
Jon Fukuda Ellie KryslDesign Planning and Management Support
October 3, 2023
"31% say design just executes product’s vision, 48% say product and design have different visions, only 21% say they work together towards shared goals."
Iain McMaster IHan ChengDesign and Product: from Frenemy to Harmony
November 29, 2023