Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Why AI projects fail (and what we can do about it)
Summary
Most AI projects fail. Somewhere between 50-90% of them, which is double the rate of more traditional tech projects. This Rosenverse Session will draw on years of Carnegie Mellon HCII research to dive into the five traps that AI projects can fall into, and then talk about what designers and project managers can do to avoid those traps. Including one startling finding: user-centered design alone isn’t enough.
Key Insights
-
•
Most AI projects fail due to choosing the wrong problems rather than poor execution.
-
•
The AI innovation gap occurs because data scientists focus on technically hard but low-value problems.
-
•
User-centered design alone often identifies problems unsuitable for AI solutions.
-
•
AI works best for low-risk, moderate accuracy (~90%), narrow tasks like spam filtering or smart text suggestions.
-
•
Executives push AI fast to avoid falling behind, risking deployments without clear user or business value.
-
•
Consequences scanning is a vital method to detect and mitigate ethical risks before AI product launch.
-
•
Matchmaking AI capabilities with real user needs and organizational goals increases project success.
-
•
Agents add new AI capabilities to sense, think, and act, requiring adapted design processes.
-
•
AI lacks context, aesthetic taste, and common sense—designers must provide these to create effective AI products.
-
•
There is currently little corporate or legal accountability for AI ethics; responsibility largely falls to product teams.
Notable Quotes
"Welcome to the AI party, we've got 10 years of research to share."
"Executives said it's better to go fast and fail than to go slow and succeed."
"AI can be magical, but it's also just not that smart."
"Don Norman was named the top accomplished woman in UX by AI, even though Don is a man."
"Companies hunt for AI innovation in technically challenging areas instead of simpler, more valuable places."
"Most AI fails because projects require near perfect accuracy, which AI can't reliably deliver."
"The traditional user-centered design process doesn't work well for AI problems."
"Matchmaking connects AI capabilities to user needs so you find the low hanging fruit projects."
"AI struggles with context, taste, and common sense, and designers bring that to the table."
"Consequences scanning helps detect unintended harms and risks before launching AI features."
Or choose a question:
More Videos
"Legacy interconnected systems mean improving one area can create problems in another, and we don't always know those constraints upfront."
Alexandra SchmidtEnterprise UX Playbook
December 1, 2022
"They’re really flexible and listen to our feedback, even though we’re a large company."
Jen Crim Jess Quittner Saritha Kattekola Alex Karr Gurbani PahwaCulture, DIBS & Recruiting
June 11, 2021
"If you’re a product manager, you don’t do very much design work anymore; you care about it but step away from the Figma."
Christian CrumlishAMA with Christian Crumlish, author of Product Management for UX People
March 24, 2022
"For women, they often won’t apply unless they meet all the bullet points in a job description."
Libby MaurerTreating Diversity & Inclusion in Hiring as a Design Problem
December 5, 2019
"When we engage people in the planning process, they take ownership of their city."
Ali Jeffery Sheri ChudowHow DesignOps Helped Enable Wall Street to Work Remotely
October 22, 2020
"Hugh Dubberly argues we should stop describing design as problem solving and instead see it as engaged conversation."
Daniel GloydDesigning From the Inside Out: How Method Acting Can Inspire Design Research
February 12, 2026
"Equipped with the right tools, we can truly meet students where they are."
Kristin SkinnerFive Years of DesignOps
September 29, 2021
"A simple quadrant diagram helped our product manager tell the story to leadership and made him look good."
Johanna KollmannInsights-Driven Product Strategy: Get your Research to Count
December 6, 2022
"Human behavior is anything but linear, rational, or predictable."
David SternbergUncovering the hidden forces shaping user behavior
July 17, 2025
Latest Books All books
Dig deeper with the Rosenbot
In what clinical workflow areas is AI currently being integrated and what are the main UX challenges associated?
How can research and operations teams collaboratively evaluate new UXR tools for usability and operational fit?
How can AI assist in vision work without replacing the need for strategic direction?