Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Sentient Design: New Postures for AI-Mediated Experiences (2nd of 3 seminars)

Wednesday, January 29, 2025 • Rosenfeld Community

This video is featured in the AI and UX playlist and 1 more.

Share the love for this talk
Sentient Design: New Postures for AI-Mediated Experiences (2nd of 3 seminars)
Speakers: Josh Clark and Veronika Kindred
Link:

Summary

How do you get your head around all the different machine-intelligent experiences available to you as a designer? What are the new design patterns, and which old ones fall away? How do you name and organize those experiences? And how do you develop an intuition for how and when to use each interaction paradigm? Watch Josh Clark and Veronika Kindred, authors of our forthcoming book Sentient Design, explore the emerging diversity of AI-mediated experiences. Just as the natural world demonstrates intelligence in many forms, the same is true for machine intelligence. New “species” of interfaces roam our screens, the manner of each tailored to purpose and environment—copilots, agents, chatbots, assistants, tools, adaptive interfaces, and many more. Sentient Design offers a framework for exploring and organizing these new experience patterns, or “postures”—the way each kind of experience positions itself in relation to the user. More than just distinct functionality, each posture has its own interaction style, manner of communication, and expectations that it sets. Josh and Veronika share over a dozen of these postures, from familiar options like dedicated tools to more exotic patterns including sculptors, bespoke UI, non-player characters, and data whisperers. Get a map for exploring these postures to expand both your perspective and your toolkit as a designer.

Key Insights

  • Sentient Design reframes AI as a design material that enables adaptive, context-aware experiences rather than just a tool for output generation.

  • The Sentient Triangle categorizes AI experiences by grounded accuracy, interoperability, and radical adaptivity to better understand their trade-offs.

  • Four key interface postures—tools, sculptors, assistants, and agents—describe how AI interfaces relate to users, from simple inputs/outputs to autonomous task management.

  • Traditional deterministic tools like Shazam remain powerful but represent early-stage AI experiences compared to more interactive and adaptive forms.

  • Inline tools integrate AI assistance seamlessly within user workflows, offering continuous and ambient support without breaking context.

  • Sculptor interfaces enable iterative collaborative content creation, exemplified by in-painting in image and audio editing.

  • Chat-based characters and personas excel in creative, exploratory scenarios where factual accuracy is less critical than engagement.

  • Agents increasingly perform delegated tasks autonomously but currently face challenges with brittle, slow, and complex multi-step workflows.

  • Bespoke UIs dynamically generate or rearrange interface components in real-time tailored to user intent, enhancing flexibility and personalization.

  • Designers must embrace AI’s inherent weirdness and unpredictability as an asset, balancing risk and opportunity to create new interaction paradigms.

Notable Quotes

"Sentient design is about intelligent interfaces that are aware of context and intent so they can be radically adaptive to user needs in the moment."

"We think of AI not just as a maker of stuff but as an enabler of experiences."

"These intelligent interfaces are collaborative, proactive partners on the user’s journey."

"Traditional software is grounded—accurate and reliable—but lacks radical adaptivity."

"In-painting allows precise, targeted edits that don’t disturb the rest of the content."

"Characters live at the extreme of radically adaptive AI—they react in the moment and follow the user’s lead."

"Assistance interfaces combine open-ended dialogue with the ability to do tasks on your behalf."

"Agents set goals, plan steps, execute them, and decide when they’re done, often without user attention."

"Bespoke UI can generate interfaces on the fly based on immediate need or intent."

"Embracing AI’s weirdness can turn unpredictable outputs into experience assets rather than liabilities."

Ask the Rosenbot
Chris Geison
Theme Two Intro
2023 • Advancing Research 2023
Gold
Raven Veal
Dark Metrics: Illuminating the Negative Impact of Digital Health Design
2021 • Advancing Research 2021
Gold
Pippa Lomas
Paving the Path for Neurodiversity in Design
2023 • DesignOps Summit 2023
Gold
Marc Majers
Interrupted UX - Add A Dose of Reality To Usability Testing
2022 • Advancing Research 2022
Gold
Jemma Ahmed
Bringing together market and user research
2019 • Advancing Research Community
Brigette Metzler
Research Repositories: A global project by the ResearchOps Community
2020 • Advancing Research Community
Chris Geison
What's Next for Research?
2021 • Advancing Research Community
Peter Boersma
How to Define and Maintain a DesignOps Roadmap
2023 • DesignOps Summit 2023
Gold
Michelle Morrison
Practice What You Preach
2024 • DesignOps Summit 2020
Gold
Victor Lombardi
Bridging Design and Climate Science
2024 • Climate UX Interest Group
Billy Carlson
Ideation tips for Product Managers
2022 • Design in Product 2022
Gold
Louis Rosenfeld
How AI will Change DesignOps Tooling
2023 • DesignOps Summit 2023
Gold
Iain McMaster
Design and Product: from Frenemy to Harmony
2023 • Design in Product 2023
Gold
Adam Cutler
People + Places + Practices = Outcomes
2016 • Enterprise UX 2016
Gold
Roberta Dombrowski
Making Research a Team Sport
2022 • Advancing Research 2022
Gold
George Zhang
UX Research Excellence Framework
2021 • Advancing Research 2021
Gold

More Videos

Sheri Byrne-Haber

"You’re not supposed to sell to the US public sector unless you’re WCAG 2.0 AA compliant."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Prayag Narula

"Most users don't know what they want until you show it to them."

Prayag Narula Hannah Hudson

Empowering Designers to do Good Research

March 11, 2022

Janelle Estes

"Inclusive research means building for diverse people, not just for ourselves or a narrow segment."

Janelle Estes

UX Research Trends

January 28, 2021

Craig Brookes

"Finding a leadership champion and building on small wins creates momentum for integrating research and content."

Craig Brookes Andreas Huebner Morgan Quinn

"Just Make it Look Good" and Other Ways We're Misunderstood

June 11, 2021

Marc Fonteijn

"Half of the service design professionals do not feel connected to their peers, which is significant."

Marc Fonteijn Ru Butler

Increase your confidence, influence, and impact (through a Professional Community)

December 3, 2024

Kate Towsey

"Research ops is heavily reliant on clear and consistent research leadership to define strategy and priorities."

Kate Towsey

The State of ResearchOps: More Than Just Theory

June 20, 2019

Alla Weinberg

"Creating safety requires specific, behavioral agreements you can observe and practice."

Alla Weinberg

Design Teams Need Psychological Safety: Here’s How to Create It

September 9, 2022

Shawna Hein

"A government designer aims to reduce UX variation while a contractor may optimize only their single product, creating potential conflicts."

Shawna Hein Kevin Hoffman

Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts

November 17, 2022

Tricia Wang

"I've thrived on being wrong and making mistakes, even when I wasn't actually wrong."

Tricia Wang

SCALE: Discussion

June 15, 2018