Rosenverse
Why AI projects fail (and what we can do about it)

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Why AI projects fail (and what we can do about it)

Wednesday, May 14, 2025 • Rosenfeld Community
Share the love for this talk
Why AI projects fail (and what we can do about it)
Speakers: Dan Saffer
Link:

Summary

Most AI projects fail. Somewhere between 50-90% of them, which is double the rate of more traditional tech projects. This Rosenverse Session will draw on years of Carnegie Mellon HCII research to dive into the five traps that AI projects can fall into, and then talk about what designers and project managers can do to avoid those traps. Including one startling finding: user-centered design alone isn’t enough.

Key Insights

  • Most AI projects fail due to choosing the wrong problems rather than poor execution.

  • The AI innovation gap occurs because data scientists focus on technically hard but low-value problems.

  • User-centered design alone often identifies problems unsuitable for AI solutions.

  • AI works best for low-risk, moderate accuracy (~90%), narrow tasks like spam filtering or smart text suggestions.

  • Executives push AI fast to avoid falling behind, risking deployments without clear user or business value.

  • Consequences scanning is a vital method to detect and mitigate ethical risks before AI product launch.

  • Matchmaking AI capabilities with real user needs and organizational goals increases project success.

  • Agents add new AI capabilities to sense, think, and act, requiring adapted design processes.

  • AI lacks context, aesthetic taste, and common sense—designers must provide these to create effective AI products.

  • There is currently little corporate or legal accountability for AI ethics; responsibility largely falls to product teams.

Notable Quotes

"Welcome to the AI party, we've got 10 years of research to share."

"Executives said it's better to go fast and fail than to go slow and succeed."

"AI can be magical, but it's also just not that smart."

"Don Norman was named the top accomplished woman in UX by AI, even though Don is a man."

"Companies hunt for AI innovation in technically challenging areas instead of simpler, more valuable places."

"Most AI fails because projects require near perfect accuracy, which AI can't reliably deliver."

"The traditional user-centered design process doesn't work well for AI problems."

"Matchmaking connects AI capabilities to user needs so you find the low hanging fruit projects."

"AI struggles with context, taste, and common sense, and designers bring that to the table."

"Consequences scanning helps detect unintended harms and risks before launching AI features."

Ask the Rosenbot
Louis Rosenfeld
About the Rosenverse
2026 • Rosenfeld Community
Ed Mullen
Designing the Unseen: Enabling Institutions to Build Public Trust
2022 • Civic Design 2022
Gold
Jon Fukuda
Theme 3 Intro
2024 • DesignOps Summit 2024
Gold
Andy Warr
Under My (Research) Umbrella: The Benefits and Challenges of Building a Unified Insights Function
2024 • Advancing Research 2024
Gold
Milan Guenther
The $212 billion ‘so what?’: unlocking impact in development cooperation
2025 • Advancing Service Design 2025
Gold
Gillian Salerno-Rebic
From Insight to Impact: How JourneySpark Used WEVO Pulse + Pro to Drive a 50% Lift in Ad Engagement
2025 • Designing with AI 2025
Gold
Dan Willis
Enterprise Storytelling Sessions
2015 • Enterprise UX 2015
Gold
World Usability Day Panel Discussion
2022 • DesignOps Community
Lija Hogan
Three Years Out: Perspectives on the Near-Term Future of User Research
2024 • Advancing Research Community
Justin Entzminger
Risk and Reward: How to Diversify the Field of Civic Innovators and Designers
2022 • Civic Design 2022
Gold
Brendan Jarvis
It was the Best of Times. It was the Worst of Times.
2024 • DesignOps Summit 2024
Gold
Chelsey Glasson
Exit Interview #3: Same as It Ever Was: What Leaving Tech Taught Me About Change
2025 • Rosenfeld Community
John Maeda
About Design Organizations
2019 • DesignOps Community
Abby Covert
Panel: Collaboration Tools
2017 • DesignOps Summit 2017
Gold
Dagmara Kukawka
Tiny team, moonshot impact: Democratizing research across continents
2026 • Advancing Research 2026
Gold
Bram Wessel
Enterprise Information Architecture
2020 • Enterprise Community

More Videos

Alexandra Schmidt

"Legacy interconnected systems mean improving one area can create problems in another, and we don't always know those constraints upfront."

Alexandra Schmidt

Enterprise UX Playbook

December 1, 2022

Jen Crim

"They’re really flexible and listen to our feedback, even though we’re a large company."

Jen Crim Jess Quittner Saritha Kattekola Alex Karr Gurbani Pahwa

Culture, DIBS & Recruiting

June 11, 2021

Christian Crumlish

"If you’re a product manager, you don’t do very much design work anymore; you care about it but step away from the Figma."

Christian Crumlish

AMA with Christian Crumlish, author of Product Management for UX People

March 24, 2022

Libby Maurer

"For women, they often won’t apply unless they meet all the bullet points in a job description."

Libby Maurer

Treating Diversity & Inclusion in Hiring as a Design Problem

December 5, 2019

Ali Jeffery

"When we engage people in the planning process, they take ownership of their city."

Ali Jeffery Sheri Chudow

How DesignOps Helped Enable Wall Street to Work Remotely

October 22, 2020

Daniel Gloyd

"Hugh Dubberly argues we should stop describing design as problem solving and instead see it as engaged conversation."

Daniel Gloyd

Designing From the Inside Out: How Method Acting Can Inspire Design Research

February 12, 2026

Kristin Skinner

"Equipped with the right tools, we can truly meet students where they are."

Kristin Skinner

Five Years of DesignOps

September 29, 2021

Johanna Kollmann

"A simple quadrant diagram helped our product manager tell the story to leadership and made him look good."

Johanna Kollmann

Insights-Driven Product Strategy: Get your Research to Count

December 6, 2022

David Sternberg

"Human behavior is anything but linear, rational, or predictable."

David Sternberg

Uncovering the hidden forces shaping user behavior

July 17, 2025