Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Sentient Scenes and Radically Adaptive Experiences

Gold
Wednesday, June 11, 2025 • Designing with AI 2025

This video is featured in the AI and UX playlist and 2 more.

Share the love for this talk
Sentient Scenes and Radically Adaptive Experiences
Speakers: Josh Clark and Veronika Kindred
Link:

Summary

Sentient Scenes is a little toy with big lessons—an intelligent interface that changes style, mood, and behavior on demand. The project explores what it means to treat AI as a design material, weaving open-ended intelligence into interfaces beyond chat. We’ll share lessons in both technique and perspective for how the designer’s role evolves—from crafting visuals to sketching prompts—and what it takes to craft systems where machine intelligence mediates the user experience.

Key Insights

  • AI can be treated as a design material with unique strengths and weaknesses rather than just a productivity tool.

  • Radically adaptive experiences adapt style, mood, behavior, and layout dynamically in response to user context and intent.

  • Open-ended AI interfaces must operate within constraints to maintain cohesion and avoid 'robot fever dreams'.

  • Large language models excel more at parsing user intent than merely providing factual answers.

  • The prompt itself becomes a hybrid artifact acting as design spec, requirement doc, and programming language.

  • Designers’ roles evolve into defining the interaction sandbox and parameters for AI-user collaboration rather than specifying every UI detail.

  • Personality and presence in AI interfaces can be achieved without pretending to be human, using animation and interaction cues.

  • Bespoke UI assembles and rearranges interface elements in real time to fit user needs, reducing complexity in workflows.

  • AI can enhance accessibility by tailoring font, color, and interaction styles to users’ abilities on demand.

  • Sentient Scenes took less than a day to build due to using plain language prompts, highlighting opportunities for rapid, imaginative prototyping.

Notable Quotes

"AI is not just a tool for productivity or efficiency; it's a design material with unusual strengths and weaknesses."

"Sentient Scenes doesn’t just talk about the scene, it becomes the scene, adapting continuously to user input."

"We wanted to create personality in interfaces without pretending they are human."

"Radically adaptive experiences are conceived and compiled in real time, responding to context and intent."

"The big design activity here is sketching prompts, guiding how the AI should behave rather than drawing UI."

"The prompt becomes part design spec, part requirement doc, and part programming language."

"Large language models are far better at figuring out what you mean than simply giving an answer."

"With bespoke UI, you don’t present every single path to the user; you let the right tool appear immediately for the job."

"AI can transform accessibility by changing experiences to meet user needs in the moment."

"This isn’t about Skynet; it’s about simple signals of awareness that adapt to immediate context."

Ask the Rosenbot
Taylor Klassman
The Evolution of UX Research Platforms
2026 • Advancing Research 2026
Gold
Miles Orkin
Creativity and Culture
2018 • DesignOps Summit 2018
Gold
Alnie Figueroa
The Future of Design Operations: Transforming Our Craft
2025 • DesignOps Summit 2025
Gold
Sahibzada Mayed
Cultivating Design Ecologies of Care, Community, and Collaboration
2023 • DesignOps Summit 2023
Gold
Sheri Byrne-Haber
The Importance of Accessible Design Systems
2024 • DesignOps Summit 2020
Gold
Mitchell Bernstein
Organizing Chaos: How IBM is Defining Design Systems with Sketch for an Ever-Changing AI Landscape
2021 • DesignOps Summit 2021
Gold
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Dave Hora
Advice for Establishing Research
2022 • Advancing Research Community
Deanna Washington
Connecting the Ops: Plenary Panel and Closing Circle
2022 • DesignOps Summit 2022
Gold
Lada Gorlenko
Theme 1: Intro
2024 • Enterprise Experience 2020
Gold
Joi Freeman
A New Vantage Point: Building a Pipeline for Multifaceted Research(ers)
2020 • Advancing Research 2020
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Sarah Kinkade
Design Management Models in the Face of Transformation
2022 • Design at Scale 2022
Gold
Abby Covert
Stuck? Diagrams Help
2022 • DesignOps Community
Gina Mendolia
Therapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems
2024 • Advancing Service Design 2024
Gold
Deanna Zandt
The Unspoken Complexity of “Self-Care” with Deanna Zandt
2022 • Civic Design Community

More Videos

Greg Petroff

"If we deeply understand outcomes and advocate for impact, we’ll be the ones making real change happen in the enterprise."

Greg Petroff

Software as Material—A Redux

June 6, 2023

Brendan Jarvis

"Socrates was known in Athenian society as a gadfly, a fly that bites livestock, for his overt and intentional interference with the Athenian power structure."

Brendan Jarvis

Framing Tomorrow by Questioning Today

June 8, 2022

Prerna Makanawala

"Achieving coherency across products leads to less training, fewer support calls, and more users successfully adopting products."

Prerna Makanawala

Achieving Balanced Design Consistency

June 9, 2021

Tricia Wang

"Language matters — calling people 'users' reflects and reinforces the reality of reduced agency."

Tricia Wang

From Users to Shapers of AI: The Future of Research

March 25, 2024

Cheryl Platz

"With great power comes great responsibility; we shouldn’t abandon using motivation techniques, or others will use them poorly."

Cheryl Platz

Embrace Your Fun Factor: Game Development Best Practices for Product Design

January 9, 2026

Ariel Kennan

"The roles of who is designing continue to shift—community designing for community, designing with community, and community members becoming consultants."

Ariel Kennan

Theme Two Intro

November 17, 2022

Tricia Wang

"Companies parachuting in to 'study' marginalized groups often do more harm than good when they don't build local capacity."

Tricia Wang

The most popular design thinking strategy is BS

January 27, 2022

Kristin Wisnewski

"The state of IT is a daily reflection of what the company thinks and feels about its employees."

Kristin Wisnewski

Measuring What Matters

October 23, 2019

Scott Jensen

"Sometimes it’s reasonable to consider your design as strategy and ship a piece now and other pieces later."

Scott Jensen Sarah Delaney Carmen Liu

Short Take #2: UX/Product Lessons from Your Industry Peers

December 6, 2022