Why AI Is Bad at Research (and how to make it actually useful)
Summary
In this session, Daniel will break down why AI often fails research teams and what’s missing. He’ll show how to make AI actually useful for continuous product research.
Accelerating analysis, connecting insights across sources, and keeping researchers at the center, equipped with a powerful tool rather than replaced by one.
Key Insights
-
•
AI in research struggles with large datasets, often averaging results and missing subtle but important signals.
-
•
Curating and filtering datasets by removing irrelevant data improves AI research output quality.
-
•
Scoping research into focused projects or topics helps AI deliver more precise responses.
-
•
Asking one question at a time significantly enhances the quality of AI-generated answers.
-
•
Providing detailed contextual information (personas, company background, product details) to AI boosts specificity and nuance in responses.
-
•
AI hallucinations and trust issues necessitate human-in-the-loop processes to verify output quality and citations.
-
•
Iterative refinement of AI outputs, similar to app development, is critical for achieving polished research results.
-
•
Spot checking AI-generated citations can be an effective and efficient way to validate research quality.
-
•
Context passed as embedded knowledge rather than repeated in prompts yields better AI results.
-
•
Using multiple specialized AI agents to critique each other’s outputs can mitigate bias and improve research accuracy.
Notable Quotes
"AI has this strange weakness that when working with a large dataset, they often miss crucial, subtle findings."
"The larger the dataset you work with, the more costly it is to run a single operation on AI models."
"Whenever possible, you should be breaking down your work into specific research projects or topics."
"When you ask a question, try to ask one at a time so the model doesn't get lost."
"Context is everything — providing AI with a folder of your company’s knowledge makes responses more detailed and useful."
"Research with AI requires as much iteration and verification as building an app or prototype."
"AI-generated research reports should always be tied to real feedback that you can verify behind every sentence."
"There's no way to deny it: every industry needs to adapt to AI, but nobody really knows how yet."
"Human in the loop means constantly interacting with AI, documenting your thoughts and assuring quality."
"Some engineers build a council of agents that debate and generate responses, which can help with bias and accuracy."
Or choose a question:
More Videos
"Employees are now suing employers for inaccessible tools, with million-dollar verdicts even in conservative courts."
Sheri Byrne-HaberThe Importance of Accessible Design Systems
January 8, 2024
"I had sorely underestimated how many internal tools there actually were — at least over 200."
Abbey Smalley Sylas SouzaScaling UX Past the Size of Your Team
January 8, 2024
"Large language models don’t think like us but have superpowers in pattern matching that help surface relationships in linked notes."
Jorge ArangoExploding the Notebook: How to Unlock the Power of Linked Notes (2nd of 3 seminars)
April 19, 2024
"Principles at this level act like a company mission that product teams can translate into their own more specific design principles."
Sarah WilliamsA Framework for CX Transformation
June 11, 2021
"Even those with a roof over their head didn’t really fare much better; unexpected expenses break the budget every time."
Yasmine KhanChecking Bias and Listening to Financially Vulnerable Americans
March 30, 2020
"I like to think about individuals as cells, teams as organs, and organizations as organisms in an ecosystem."
Dave MaloufTheme 3: Introduction and Provocation
January 8, 2024
"Our goal ultimately is not to deploy a static solution but to make sure humans in the system achieve their goals successfully as often as possible."
Jeff GothelfWho does what by how much?
November 20, 2025
"The key to combating survey fatigue is short surveys triggered at the right context, making respondents feel listened to and valued."
Aleksandra Korczynska Caroline Jarrett Justyna ParmeeSurvey Tools
March 12, 2026
"The three in the box model is business, design, and technical representation, plus legal and compliance in regulated environments."
Frank DuranPartnership Playbook: Lessons Learned in Effective Partnership
January 8, 2024
