Rosenverse
Don't botch the bot: Designing interactions for AI

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Don't botch the bot: Designing interactions for AI

Gold
Tuesday, June 4, 2024 • Designing with AI 2024
Share the love for this talk
Don't botch the bot: Designing interactions for AI
Speakers: Savannah Carlin
Link:

Summary

It seems like every company is adding a conversational AI chatbot to their website lately, but how do you actually go about making these experiences valuable and intuitive? Savannah Carlin will present a case study on a conversational AI chatbot—Marqeta Docs AI—that she designed for a developer documentation site in the fintech industry. She will share her insights, mistakes, and perspectives on how to use AI in a meaningful, seamless way, especially for companies like Marqeta that operate in highly regulated industries with strict compliance standards. The talk will use specific examples and visuals to show what makes conversational AI interactions uniquely challenging and the design patterns that can address those challenges. These include managing user expectations, handling errors or misunderstandings within the conversation, and ensuring that users can quickly judge the quality of a bot’s response. You’ll gain a deeper understanding of the intricacies involved in designing interactions for AI, along with practical advice you can apply in your own design processes. Take-aways
  • What to consider before you add AI to your product to ensure it will be valuable, usable, and safe for its intended workflows
  • The interactions that are unique to conversational AI experiences and the design patterns that work for them
  • Common challenges in designing conversational AI experiences and how to overcome them

Key Insights

  • •

    Defining a clear and specific primary use case is crucial before starting any generative AI chatbot project.

  • •

    High-quality, thoroughly reviewed training data is foundational to delivering accurate and useful AI outputs.

  • •

    Initial state messaging must clearly frame what the chatbot can and cannot help with to reduce irrelevant or off-topic queries.

  • •

    Loading indicators for AI text responses should be subtle, with progress reflected by text appearing rather than distracting animations.

  • •

    Supporting efficient scrolling and prompt review is vital since users frequently check and refine their inputs against often long answers.

  • •

    Error states in AI chatbots shift from traditional fixed errors to helping users write better prompts to get more relevant results.

  • •

    Transparency about accuracy, AI limitations, and source citations builds user trust, especially in regulated domains like FinTech.

  • •

    Providing users with prompt engineering guidance via documentation significantly improves the quality of chatbot interactions.

  • •

    Accessibility considerations, like keyboard navigation and screen reader compatibility, must be integrated from the start, especially given the large text outputs.

  • •

    Chatbots can reduce customer support friction and encourage users to ask questions they might not have otherwise, enhancing user engagement with the product.

Notable Quotes

"If you have any doubts about the quality of the training data, do not proceed."

"You want to assist people in framing the interaction and setting their expectations correctly so they know how to be successful."

"The biggest difference with error states in AI bots is helping people write prompts effectively, not just recovering from simple failures."

"Loading text itself is a loading indicator; the letters appearing show progress better than jumpy animations."

"People often forget what they wrote and then want to check their prompt again before refining it."

"Every output should have at least three source links, almost like citations in a research paper."

"We had to be very careful about accuracy because we're in FinTech and compliance is critical."

"People started asking questions to the bot that they wouldn’t have taken the time to email about."

"It’s really important to be clear and transparent about what the tool is good at and what it’s not good at."

"Accessibility testing included making sure everyone could navigate it using a keyboard alone."

Ask the Rosenbot
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Enterprise UX 2023
Gold
Joshua Graves
We Need To Talk: Addressing Unmet Expectations (Part 2 of 3)
2025 • Rosenfeld Community
Billy Carlson
Principles of Team Wireframing
2023 • DesignOps Summit 2023
Gold
Theresa Neil
Designing for Wellness: Specializing in Healthcare
2024 • Rosenfeld Community
Lori Muszynski
Keeping Design Weird
2023 • DesignOps Summit 2023
Gold
James Lang
If you can design an app, you can design a community
2025 • Rosenfeld Community
Lada Gorlenko
Theme 2 Intro
2022 • Design at Scale 2022
Gold
Carol Scott
Avoid Harming Your Team and Users: Promoting Care and Brand Reputation with Trauma-Informed UX Practices
2025 • Rosenfeld Community
Cennydd Bowles
Exit Interview #2: Rediscovering the ethical heart of design
2025 • Rosenfeld Community
Catt Small
What's Next for ICs: Exploring Staff and Principal Designer Roles
2024 • Rosenfeld Community
JD Buckley
COMMUNICATE: Discussion
2018 • Enterprise Experience 2018
Gold
Sahibzada Mayed
Cultivating Design Ecologies of Care, Community, and Collaboration
2023 • DesignOps Summit 2023
Gold
Savannah Carlin
Don't botch the bot: Designing interactions for AI
2024 • Designing with AI 2024
Gold
Vincent Brathwaite
Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams
2020 • DesignOps Summit 2020
Gold
Taylor Jennings
Research Debate Club
2026 • Advancing Research 2026
Gold
Daniel Orbach
Zero to One: Co-Creating Operating Models with your Team
2024 • DesignOps Summit 2024
Gold

More Videos

Corey Long

"Layoffs take on average two years to recover from the psychological trauma of losing a job."

Corey Long

Hiring in DesignOps: A Critical Study on How to Hire and Get Hired

September 23, 2024

Gretchen Anderson

"Human-centered design is not just about your end users, it’s about the humans in your team."

Gretchen Anderson

Scaling the Human Center

June 8, 2017

Lori Muszynski

"Your work is not your identity. You are gonna hear no, and that’s okay."

Lori Muszynski Peter Merholz

Keeping Design Weird

October 2, 2023

Sam Proulx

"Screen readers let us jump directly to content, replicating visual skimming of a web page."

Sam Proulx

SUS: A System Unusable for Twenty Percent of the Population

June 9, 2021

Prayag Narula

"Companies have started building their own base camps, but these feel more exclusionary compared to grassroots ones."

Prayag Narula Rida Qadri

HCI 2.0: Humanity Deserves the Attention that UX Research has to Offer

March 28, 2023

Deanna Smith

"Not everything that is faced can be changed, but nothing can be changed until it is faced."

Deanna Smith

Leading Change with Confidence: Strategies for Optimizing Your Process

September 23, 2024

Lija Hogan

"Empathic data is the most accessible starting point for people who are not trained researchers."

Lija Hogan

Doing more with more: Lessons from the Front Lines of Democratization

March 9, 2022

Sam Proulx

"Whenever someone makes a game accessible today, it’s considered an inspiring hack not a built-in feature."

Sam Proulx

To Boldly Go: The New Frontiers of Accessibility

March 11, 2022

Bria Alexander

"A little color purple to start the day. Good morning."

Bria Alexander

Opening Remarks

October 3, 2023