Managing the Human Engagement Risks of AI
This video is featured in the Designing with AI 2025 playlist and 1 more.
Summary
AI is fast transforming the way companies operate and design products and services. New design practices like “vibe coding,” or “prompt engineering,” are accelerating product launches at speed and scale. But with the rush to market; how can teams maintain their commitment to human-centered design, minimize the risks to consumers and keep up with the increase in developer velocity? We showcase various tactics companies are using to manage the risk of implementing AI into their products while keeping their ever tightening GTM timelines.
Key Insights
-
•
Generative AI does not think or understand; it excels at pattern recognition and filling in blanks like a souped-up mad lib.
-
•
AI design requires a paradigm shift from building products to designing dynamic behaviors within multi-agent ecosystems.
-
•
UX designers must move beyond traditional user-device interaction design to address machine learning's stochastic and contextual outputs.
-
•
Generative AI models have no moral code and can generate harmful outputs without human-guided guardrails and feedback loops.
-
•
Red teaming, adversarial testing, and safety classifiers are essential tools to proactively identify and mitigate AI risks.
-
•
Data and model cards documenting dataset provenance and model training are crucial for auditing bias and risk in AI systems.
-
•
Automation bias can cause humans to overtrust AI outputs, requiring design strategies that clearly signal uncertainty and keep users in control.
-
•
Machine learning models can unlearn harmful behaviors given correct feedback, but timely monitoring is critical before embedded biases solidify.
-
•
Mindful AI design entails co-design, simulations of multiple futures, and iterative testing with diverse users to understand AI behavior in context.
-
•
UX professionals hold unique responsibility and agency to embed ethical, equitable practices in AI design and deployment.
Notable Quotes
"Generative AI is a souped up mad lib, its job is to fill in the blank."
"Good UX and good design need not only to make a comeback but lead the way in this era of AI."
"In the post software era, we have to think about how products will behave, not just how they are built."
"The user and machine can both be in control; technology affordance changes over time and outcomes are dynamic."
"Generative AI has no moral code; you have to discipline it so it can learn right from wrong."
"There is no unbiased creation of machine learning or artificial intelligence; the idea of agnostic algorithms is a myth."
"You have to build guardrails and test models with red teaming to ensure they behave ethically and safely."
"Minimize anthropomorphism in AI design so users know they are engaging with machines, not humans."
"Machine learning models can unlearn behaviors, but we need robust feedback loops to detect when they go awry."
"The more that you engage with AI technology, the better confidence you will have in designing with it."
Or choose a question:
More Videos
"Enterprise UX often pulls designers into adoption and training roles, even if that feels outside traditional design work."
Alexandra SchmidtEnterprise UX Playbook
December 1, 2022
"Our offices have stand-up desks, nice collaboration areas, and comfy seating with a fresh, on-brand look."
Jen Crim Jess Quittner Saritha Kattekola Alex Karr Gurbani PahwaCulture, DIBS & Recruiting
June 11, 2021
"SAFe often turns UX into just digital or visual designers, which is wasteful and marginalizes valuable skills."
Christian CrumlishAMA with Christian Crumlish, author of Product Management for UX People
March 24, 2022
"We treated diversity and inclusion like a sprint instead of the marathon that it truly is."
Libby MaurerTreating Diversity & Inclusion in Hiring as a Design Problem
December 5, 2019
"Green spaces are not luxuries—they're necessities for urban life."
Ali Jeffery Sheri ChudowHow DesignOps Helped Enable Wall Street to Work Remotely
October 22, 2020
"Patricia Moore’s aging research revealed how product design often excludes elderly users by living their constraints."
Daniel GloydDesigning From the Inside Out: How Method Acting Can Inspire Design Research
February 12, 2026
"Every student has unique strengths that should be recognized and nurtured."
Kristin SkinnerFive Years of DesignOps
September 29, 2021
"The service wasn’t achieving the impact it was set out to have because the regulations governing everything else were not fit for purpose."
Johanna KollmannInsights-Driven Product Strategy: Get your Research to Count
December 6, 2022
"When you observe a quantum particle, its possible states collapse to one—just like user intent collapses to action."
David SternbergUncovering the hidden forces shaping user behavior
July 17, 2025
Latest Books All books
Dig deeper with the Rosenbot
Why is interoperability and API access critical in modern user research tooling ecosystems?
Why is design education’s emphasis on critical making important, and how does it interrelate with critique and theory?
What does a successful healthcare UX career look like in terms of accumulating influence and aligning with clinical/business goals?