Disrupting generative AI products with just-in-time consumer insights
Summary
Key Insights
-
•
Building AI products requires giving up control over user experience as outputs vary uniquely per user.
-
•
Traditional usability testing is insufficient for AI products; longitudinal testing with repeated sessions is critical.
-
•
Human-in-the-loop 'Wizard of Oz' testing effectively simulates AI to rapidly test assumptions before building.
-
•
Model drift in LLMs can cause unpredictable or inappropriate responses, requiring mechanisms like turn capping.
-
•
Users form evolving relationships with AI assistants, which need careful design and testing over time.
-
•
Many product orthodoxies based on fixed experiences expire with generative AI and must be reinvented.
-
•
Failure early and often is essential in AI product development due to its inherent unpredictability.
-
•
Users may lack mental models for AI assistants, making onboarding and user education a bigger challenge.
-
•
Asynchronous, multi-threaded conversations are natural for humans but difficult for bots to handle accurately.
-
•
AI can automate synthesis tasks, enabling humans to focus on creativity, accountability, and authenticity.
Notable Quotes
"Building on AI and generative AI means giving up control."
"If the folks that design this tech don’t know how it works, it’s okay if you don’t know either."
"Alignment inevitably means changing minds."
"Everyone’s gonna be wrong. If you’re right all the time, you’re probably not taking big enough swings."
"With LLMs, the product itself is no longer a dependent variable; experiences diverge per user."
"We are studying experiences in ecosystems, not just products anymore."
"Failing early is critical because you can’t control the model."
"The promise of an LLM assistant requires users to build new mental models while using it."
"Turn capping helps reset the model to prevent drift but introduces new problems around memory."
"Creativity, accountability, and authenticity are going to be the new markers of humanity."
Or choose a question:
More Videos
"Everyone goes through quite an extensive application process, but it was stress-free and informal."
Marc Fonteijn Ru ButlerIncrease your confidence, influence, and impact (through a Professional Community)
December 3, 2024
"You have to make the hard thing easier to do. Behavioral change must be lower friction."
Dem Gerolemou Alexis Oh Neef RehmanClimate technology fundamentals
May 15, 2024
"We offer a quantitative approach so you can quickly recognize the strengths and weaknesses in a product compared to competitors."
Daniela Magaña Flores Ariane Rahn Jeff Ephraim BanderAhead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
March 10, 2022
"I met with my partners and leaders to really dig into their hopes, fears, and dreams about where they wanted to go."
Abbey Smalley Sylas SouzaScaling UX Past the Size of Your Team
January 8, 2024
"We immediately transitioned designers embedded on lower priority projects to higher priority ones."
Patrick CommarfordDesign Staffing for Impact
January 8, 2024
"Data sovereignty is about who owns your data, which country’s laws apply, and how vulnerable groups are fairly protected."
Xenia Adjoubei Sean BruceEmpowering Communities Through the Researcher in Residence Program
March 29, 2023
"Make it easy to do the right thing, and as a side effect, make it harder to do the wrong thing."
Craig VillamorDesign Systems for Ethical Design
January 26, 2023
"A designer working on a new component needs to understand not just that component but the templates using it and overall approach."
Jon Fukuda Ellie KryslDesign Planning and Management Support
October 3, 2023
"If you’re not embarrassed by what you share, you’ll share too late."
Iain McMaster IHan ChengDesign and Product: from Frenemy to Harmony
November 29, 2023
