Rosenverse
Sentient Scenes and Radically Adaptive Experiences

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Sentient Scenes and Radically Adaptive Experiences

Gold
Wednesday, June 11, 2025 • Designing with AI 2025

This video is featured in the AI and UX playlist and 2 more.

Share the love for this talk
Sentient Scenes and Radically Adaptive Experiences
Speakers: Josh Clark and Veronika Kindred
Link:

Summary

Sentient Scenes is a little toy with big lessons—an intelligent interface that changes style, mood, and behavior on demand. The project explores what it means to treat AI as a design material, weaving open-ended intelligence into interfaces beyond chat. We’ll share lessons in both technique and perspective for how the designer’s role evolves—from crafting visuals to sketching prompts—and what it takes to craft systems where machine intelligence mediates the user experience.

Key Insights

  • •

    AI can be treated as a design material with unique strengths and weaknesses rather than just a productivity tool.

  • •

    Radically adaptive experiences adapt style, mood, behavior, and layout dynamically in response to user context and intent.

  • •

    Open-ended AI interfaces must operate within constraints to maintain cohesion and avoid 'robot fever dreams'.

  • •

    Large language models excel more at parsing user intent than merely providing factual answers.

  • •

    The prompt itself becomes a hybrid artifact acting as design spec, requirement doc, and programming language.

  • •

    Designers’ roles evolve into defining the interaction sandbox and parameters for AI-user collaboration rather than specifying every UI detail.

  • •

    Personality and presence in AI interfaces can be achieved without pretending to be human, using animation and interaction cues.

  • •

    Bespoke UI assembles and rearranges interface elements in real time to fit user needs, reducing complexity in workflows.

  • •

    AI can enhance accessibility by tailoring font, color, and interaction styles to users’ abilities on demand.

  • •

    Sentient Scenes took less than a day to build due to using plain language prompts, highlighting opportunities for rapid, imaginative prototyping.

Notable Quotes

"AI is not just a tool for productivity or efficiency; it's a design material with unusual strengths and weaknesses."

"Sentient Scenes doesn’t just talk about the scene, it becomes the scene, adapting continuously to user input."

"We wanted to create personality in interfaces without pretending they are human."

"Radically adaptive experiences are conceived and compiled in real time, responding to context and intent."

"The big design activity here is sketching prompts, guiding how the AI should behave rather than drawing UI."

"The prompt becomes part design spec, part requirement doc, and part programming language."

"Large language models are far better at figuring out what you mean than simply giving an answer."

"With bespoke UI, you don’t present every single path to the user; you let the right tool appear immediately for the job."

"AI can transform accessibility by changing experiences to meet user needs in the moment."

"This isn’t about Skynet; it’s about simple signals of awareness that adapt to immediate context."

Ask the Rosenbot
Jon Fukuda
Design Planning and Management Support
2023 • DesignOps Summit 2023
Gold
Ash Brown
Silver Linings: What DesignOps Learned in the Shift to WFH
2020 • DesignOps Summit 2020
Gold
Lada Gorlenko
Theme 2 Intro
2022 • Design at Scale 2022
Gold
Rebecca Topps
Planning and conducting remote usability studies for accessibility
2020 • Advancing Research Community
Aditi Ruiz
A PM State of Mind: Empathy Mapping Your Product Manager, Pt. 1
2022 • Design in Product 2022
Gold
Dave Malouf
The Future of DesignOps
2024 • DesignOps Summit 2020
Gold
Louis Rosenfeld
The Rosenbot and the Rosenverse: An AMA with Lou Rosenfeld
2024 • Designing with AI 2024
Gold
Dan Willis
Enterprise Storytelling Sessions
2019 • Enterprise Experience 2019
Gold
Jonathan Fairman
Integrating generative AI into enterprise products: A case study from dscout
2024 • Designing with AI 2024
Gold
Jayne Engle
Civic Design for the Next Seven Generations—A Discussion on Sacred Civics
2022 • Civic Design Community
Alexia Cohen
Increasing Health Equity and Improving the Service Experience for Under-Served Latine Communities in Arizona
2024 • Advancing Service Design 2024
Gold
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • DesignOps Summit 2023
Gold
Aurobinda Pradhan
Introduction to Collaborative DesignOps using Cubyts
2022 • DesignOps Summit 2022
Gold
George Aye
That Quiet Little Voice: When Design and Ethics Collide
2022 • Civic Design 2022
Gold
Sheryl Cababa
Day 2 Panel
2024 • Designing with AI 2024
Gold
Maria Giudice
Remaking the Making Company: Moving from Product to Experience
2016 • Enterprise UX 2016
Gold

More Videos

Mark Interrante

"The challenge of prioritization increases when decisions are adaptive, systemic, and dynamic."

Mark Interrante Harry Max

AI for Prioritization (3rd of 3 seminars)

July 11, 2024

Patrizia Bertini

"Next year we need to have an accessibility budget. You do what you want, but that's the choice."

Patrizia Bertini

The (r)evolution of designOps: It’s Time to Think (really) BIG

September 11, 2025

Shan Shen

"A tree test focuses on intuitive navigation while a prototype aims for the desired modality of an end solution."

Shan Shen

Translating UX Terms into Business Contexts

November 29, 2023

Adam Thomas

"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."

Adam Thomas

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

December 6, 2022

Robin Beers

"Research is inherently a silo-busting activity because customers experience the whole, not just parts divided by departments."

Robin Beers

Research as a Catalyst for Organizational Transformation

March 12, 2021

Sheri Byrne-Haber

"Accessibility isn’t just about visible disabilities; it’s about invisible disabilities and situational impairments too."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Joseph Meersman

"Critiques help teams stop being the lone ranger and instead iterate faster together with purpose and clarity."

Joseph Meersman

Sweating the Pixel: Scaling Quality through Critique

June 10, 2021

Deanna Washington

"Make a business case for yourself by bragging about your capabilities and making them applicable."

Deanna Washington Bria Alexander Jon Fukuda Saara Kamppari-Miller Farid Sabitov

Connecting the Ops: Plenary Panel and Closing Circle

September 9, 2022

Aaron Stienstra

"We built an equity learning community with 25 virtual sessions, 4 interagency roundtables, and one-on-one consultations with 37 agencies."

Aaron Stienstra Lashanda Hodge

Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government

December 8, 2021