Rosenverse
Building the Rosenbot

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Building the Rosenbot

Gold
Tuesday, June 4, 2024 • Designing with AI 2024
Share the love for this talk
Building the Rosenbot
Speakers: Peter Van Dijck
Link:

Summary

A 30-minute deep-dive into the building of the Rosenbot. We’ll get both hands-on practical and likely a bit philosophical. What does it take to build a useful AI assistant? What does it mean for a business, strategically? And how do we make sure we are building the future that we want, while doing all this? Take-aways: What does strategy look like in an AI world? What does eval-first mean? What the hell is going on deep inside an LLM? And what does all that mean for the future we want to build?

Key Insights

  • Generative AI is a new design material requiring fresh approaches distinct from prior UX methods.

  • Rose Bot leverages retrieval augmented generation to semantically search Rosenfeld’s extensive UX content.

  • Conversation logic beyond the LLM is essential to route, classify intents, and ensure safe responses.

  • Evaluation (eval) of AI is fundamentally challenging due to its non-deterministic input and output.

  • Effective evaluation requires combining human expert and end-user feedback alongside automated tools.

  • A third of a project’s budget and time should be dedicated solely to rigorous AI evaluation.

  • ‘Prompt deep dive’ usability testing spends extended time on individual prompts to deeply understand interactions.

  • New tooling is emerging specifically for tracing conversations, prompt engineering, and observability in AI.

  • UX roles remain vital in AI development by inventing new research techniques and ensuring user-centered design.

  • Co-creation between users and technology defines how AI applications evolve and succeed or fail.

Notable Quotes

"When GPT came out, my kids immediately adopted it at school and couldn’t pry it from their dead hands."

"This AI stuff is a new design material, just like the internet or mobile was before."

"The Rose Bot has read everything—every piece of Rosenfeld’s knowledge—to help users access it."

"Building generative AI tools is not scary, it’s just very different from the last 20 years of building products."

"There’s a lot of steps behind the scenes to make conversations useful and safe."

"Eval is the engineering word for evaluation, but also what researchers and UX designers naturally do."

"Without proper evaluation, you’re just building a demo – demos are easy, quality production is hard."

"We invented the ‘prompt deep dive’ technique to spend lots of time on one prompt to deeply understand it."

"Co-creation between users and technology determines if this AI evolves to be useful or harmful."

"We should feel okay to throw away old assumptions and tooling and invent new techniques for this new world."

Ask the Rosenbot
Robin Beers
Research as a Catalyst for Organizational Transformation
2021 • Advancing Research 2021
Gold
Erin Weigel
Real-world lessons to improve your conversion rates
2024 • Rosenfeld Community
Dave Hora
A Research Skills Evolution
2021 • Advancing Research 2021
Gold
Heidi Trost
When AI Becomes the User’s Point Person—and Point of Failure
2025 • Rosenfeld Community
Rich Mironov
How Can Product Managers and UXers Help Each Other (and Why are Product Folks so Annoying Sometimes)?
2022 • Design in Product 2022
Gold
Louis Rosenfeld
Founder’s Welcome
2022 • Design in Product 2022
Gold
Megan Blocker
Getting to the “So What?”: How Management Consulting Practices Can Transform Your Approach to Research
2024 • Advancing Research 2024
Gold
Jemma Ahmed
Theme 1 Intro
2026 • Advancing Research 2026
Gold
Taylor Jennings
Research Debate Club
2026 • Advancing Research 2026
Gold
Lena Shenkarenko
Collaborative Wireframing for Creating Team Alignment and Shipping Better Products
2020 • DesignOps Summit 2020
Gold
JP Allen
Navigating the UX Tools Landscape
2021 • DesignOps Summit 2021
Gold
Greg Petroff
Software as Material—A Redux
2023 • Enterprise UX 2023
Gold
Johnny Michaelsen
Measure Behaviors, Not Results
2026 • Rosenfeld Community
Sheryl Cababa
Integrating Systems Thinking Into Your Practice as a Designer
2025 • Rosenfeld Community
Sarah Fathallah
A Typology of Participation in Participatory Research
2023 • Advancing Research 2023
Gold
Michael Land
Establishing Design Operations in Government
2021 • DesignOps Community

More Videos

Alexia Cohen

"We decided with the COP to view our budget as a moral document."

Alexia Cohen Adriane Ackerman

Increasing Health Equity and Improving the Service Experience for Under-Served Latine Communities in Arizona

December 4, 2024

Marc Majers

"Building in interruptions exponentially increases the accuracy of the findings."

Marc Majers Tony Turner

Interrupted UX - Add A Dose of Reality To Usability Testing

March 11, 2022

Jorge Arango

"The challenge for us is how might we act more skillfully under conditions of VUCA."

Jorge Arango

Design as an Antidote to VUCA

May 9, 2019

Brenna Fallon

"People work with autonomy, mastery, and purpose. Autonomy is very motivating."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Daniel Gloyd

"Design is often framed as problem solving, but conversation is a better framework to respect users as active experts."

Daniel Gloyd

Warming the User Experience: Lessons from America's first and most radical human-centered designers

May 9, 2024

Sam Proulx

"A good two-factor system offers multiple methods, like authenticator apps, calls, and texts, with generous timeouts."

Sam Proulx

Online Shopping: Designing an Accessible Experience

October 3, 2023

Kristin Skinner

"Data is not just numbers; it tells us the story of student learning."

Kristin Skinner

Five Years of DesignOps

September 29, 2021

Denise Jacobs

"If you’re not doing the work of addressing your own pain, you won’t be effective in helping others."

Denise Jacobs Nancy Douyon Renee Reid Lisa Welchman

Interactive Keynote: Social Change by Design

January 8, 2024

Roberta Dombrowski

"I was surprised how quickly I could launch a project and get six leads within just a few hours using User Interviews."

Roberta Dombrowski Lianna Aduana

5 Reasons to Bring your Recruiting in House

September 30, 2021