Augment the Human. Interrogate the System.
Summary
Key Insights
-
•
Designers and data scientists approach problems differently, so collaboration is essential to merge human values with data capabilities.
-
•
Anticipatory design allows systems to predict and respond to user needs without explicit requests, enhancing relevance and convenience.
-
•
Humans tend to overtrust AI systems, but lose trust quickly when predictions are wrong, requiring designs that balance skepticism with recourse.
-
•
The pedal assist metaphor frames AI as augmenting human skill rather than replacing it, allowing users to adjust levels of automation.
-
•
Using AI to scaffold human memory and intuition supports cognition instead of automating it away, preserving human abilities.
-
•
Teaming humans with AI helps users handle complex data patterns that are otherwise difficult to perceive or verify.
-
•
Effective design interfaces provide users with in-moment verification tools to explore, challenge, and correct AI-generated content.
-
•
Ethical concerns about manipulation, surveillance, and marginalization need careful consideration in anticipatory systems.
-
•
Younger, digital native designers are more enthusiastic but less critical about AI, while older students bring caution and skepticism.
-
•
Building shared vocabulary between designers and data scientists is crucial to creating meaningful AI-driven design solutions.
Notable Quotes
"Designers need data, but data also needs designers."
"If we aren’t crafting experiences that support a thoughtful, ethical confluence of human and machine, humanity is never gonna get to enjoy that meal."
"Anticipatory design is design anticipating customer needs and serving up what they want before they request it."
"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."
"Trust erodes very quickly the moment an AI prediction is a little off or wrong."
"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."
"Working with AI is a lot less like working with another human and more like working with some weird force of nature."
"AI has no understanding of consequences — humans are the ones to bring that understanding."
"The relationship between designers and data scientists can actually be pretty magical."
"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."
Or choose a question:
More Videos
"Open source lets companies like Dell, IBM, and the UK government collaborate legally and share accessibility improvements."
Sheri Byrne-HaberThe Importance of Accessible Design Systems
January 8, 2024
"Hands-on activities like practicing user interviews and design sprint sketches gave people courage to try UX tactics in the real world."
Abbey Smalley Sylas SouzaScaling UX Past the Size of Your Team
January 8, 2024
"Hypertext notes coexist on the same level and link to each other arbitrarily, creating emergent structures."
Jorge ArangoExploding the Notebook: How to Unlock the Power of Linked Notes (2nd of 3 seminars)
April 19, 2024
"We realized we didn’t have a well-articulated purpose or guiding principles for the types of customer experiences we aspired to deliver."
Sarah WilliamsA Framework for CX Transformation
June 11, 2021
"You need to be just as careful conducting interviews in Beverly Hills as in poorer neighborhoods; wealth does not guarantee safety."
Yasmine KhanChecking Bias and Listening to Financially Vulnerable Americans
March 30, 2020
"When your design organization becomes its own business unit, that’s when you truly scale."
Dave MaloufTheme 3: Introduction and Provocation
January 8, 2024
"Key results must be measures of human behavior and outcomes, not output metrics like 'launch this service'."
Jeff GothelfWho does what by how much?
November 20, 2025
"The hardest part is acting on feedback, which requires integrating tools and aligning multiple teams like research, product, marketing, and customer success."
Aleksandra Korczynska Caroline Jarrett Justyna ParmeeSurvey Tools
March 12, 2026
"When you put in that effort, you’re going to get the advocacy not only from your team but within the organization."
Frank DuranPartnership Playbook: Lessons Learned in Effective Partnership
January 8, 2024