Rosenverse
Augment the Human. Interrogate the System.

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Augment the Human. Interrogate the System.

Gold
Wednesday, June 7, 2023 • Enterprise UX 2023
Share the love for this talk
Augment the Human. Interrogate the System.
Speakers: Helen Armstrong
Link:

Summary

Designers stand at the verge of a great professional opportunity: artificial intelligence. This technology enables computers to study the world and make predictions using unstructured data. We can speak to machines—and machines can speak back. We can gesture to devices, expressing emotion and intent, and machines can respond meaningfully. We can look to computers not just for interaction, but for companionship. How can designers adapt and thrive in this evolving terrain? How might we map out new brands, platforms and experiences between human and machine? What dangers must we address? What destructive ideologies must we reveal? What possibilities for a better future might we explore and prototype?

Key Insights

  • •

    Designers and data scientists approach problems differently, so collaboration is essential to merge human values with data capabilities.

  • •

    Anticipatory design allows systems to predict and respond to user needs without explicit requests, enhancing relevance and convenience.

  • •

    Humans tend to overtrust AI systems, but lose trust quickly when predictions are wrong, requiring designs that balance skepticism with recourse.

  • •

    The pedal assist metaphor frames AI as augmenting human skill rather than replacing it, allowing users to adjust levels of automation.

  • •

    Using AI to scaffold human memory and intuition supports cognition instead of automating it away, preserving human abilities.

  • •

    Teaming humans with AI helps users handle complex data patterns that are otherwise difficult to perceive or verify.

  • •

    Effective design interfaces provide users with in-moment verification tools to explore, challenge, and correct AI-generated content.

  • •

    Ethical concerns about manipulation, surveillance, and marginalization need careful consideration in anticipatory systems.

  • •

    Younger, digital native designers are more enthusiastic but less critical about AI, while older students bring caution and skepticism.

  • •

    Building shared vocabulary between designers and data scientists is crucial to creating meaningful AI-driven design solutions.

Notable Quotes

"Designers need data, but data also needs designers."

"If we aren’t crafting experiences that support a thoughtful, ethical confluence of human and machine, humanity is never gonna get to enjoy that meal."

"Anticipatory design is design anticipating customer needs and serving up what they want before they request it."

"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."

"Trust erodes very quickly the moment an AI prediction is a little off or wrong."

"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."

"Working with AI is a lot less like working with another human and more like working with some weird force of nature."

"AI has no understanding of consequences — humans are the ones to bring that understanding."

"The relationship between designers and data scientists can actually be pretty magical."

"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."

Ask the Rosenbot
Jonathan Fairman
Integrating generative AI into enterprise products: A case study from dscout
2024 • Designing with AI 2024
Gold
Scher Foord
Turn the Ship Around: How to Apply Design Thinking Across Your Organization
2021 • Design at Scale 2021
Gold
Jennifer Kong
Journeying toward AI-assisted documentation in healthcare
2024 • Designing with AI 2024
Gold
Laurent Christoph
Scale the impact of DesignOps in 3D: Diligence, Decision, Discipline
2025 • DesignOps Community
Deanna Washington
Scaling Success: Paving the Path from DesignOps to VP
2023 • DesignOps Summit 2023
Gold
Mariah Hay
BUILD: Discussion
2018 • Enterprise Experience 2018
Gold
Harry Brignull
Beyond Clicks and Tricks: Why deceptive design has grown into a regulatory faultline
2026 • Rosenfeld Community
Eniola Oluwole
Lessons From the DesignOps Journey of the World's Largest Travel Site
2019 • DesignOps Summit 2019
Gold
Kurt McCulloch
Faster alone, further together: Rebuilding collaboration in the age of AI research
2026 • Advancing Research 2026
Gold
Ed Mullen
Designing the Unseen: Enabling Institutions to Build Public Trust
2022 • Civic Design 2022
Gold
Kaitlin Tasker
Fast and Fearless Inclusive Research
2023 • Advancing Research 2023
Gold
Maria Rosala
Research Repositories
2026 • Advancing Research 2026
Gold
Yalenka Mariën
Designing for Digital Inclusion in the Belgian Government
2021 • Civic Design 2021
Gold
Peter Merholz
Customer-Centered Design Organizations
2017 • Enterprise Experience 2017
Gold
Dianne Que
Real Talk: Proving Value through a Scrappy Playbook
2019 • DesignOps Summit 2019
Gold
Aletheia Delivre
New Shapes and Emerging Identities for Design Ops
2025 • DesignOps Summit 2025
Gold

More Videos

Sheri Byrne-Haber

"Open source lets companies like Dell, IBM, and the UK government collaborate legally and share accessibility improvements."

Sheri Byrne-Haber

The Importance of Accessible Design Systems

January 8, 2024

Abbey Smalley

"Hands-on activities like practicing user interviews and design sprint sketches gave people courage to try UX tactics in the real world."

Abbey Smalley Sylas Souza

Scaling UX Past the Size of Your Team

January 8, 2024

Jorge Arango

"Hypertext notes coexist on the same level and link to each other arbitrarily, creating emergent structures."

Jorge Arango

Exploding the Notebook: How to Unlock the Power of Linked Notes (2nd of 3 seminars)

April 19, 2024

Sarah Williams

"We realized we didn’t have a well-articulated purpose or guiding principles for the types of customer experiences we aspired to deliver."

Sarah Williams

A Framework for CX Transformation

June 11, 2021

Yasmine Khan

"You need to be just as careful conducting interviews in Beverly Hills as in poorer neighborhoods; wealth does not guarantee safety."

Yasmine Khan

Checking Bias and Listening to Financially Vulnerable Americans

March 30, 2020

Dave Malouf

"When your design organization becomes its own business unit, that’s when you truly scale."

Dave Malouf

Theme 3: Introduction and Provocation

January 8, 2024

Jeff Gothelf

"Key results must be measures of human behavior and outcomes, not output metrics like 'launch this service'."

Jeff Gothelf

Who does what by how much?

November 20, 2025

Aleksandra Korczynska

"The hardest part is acting on feedback, which requires integrating tools and aligning multiple teams like research, product, marketing, and customer success."

Aleksandra Korczynska Caroline Jarrett Justyna Parmee

Survey Tools

March 12, 2026

Frank Duran

"When you put in that effort, you’re going to get the advocacy not only from your team but within the organization."

Frank Duran

Partnership Playbook: Lessons Learned in Effective Partnership

January 8, 2024