Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Day 1 Panel

Gold
Tuesday, June 4, 2024 • Designing with AI 2024
Share the love for this talk
Day 1 Panel
Speakers: Cennydd Bowles , Dan Rosenberg and Lisa Welchman
Link:

Summary

In this panel discussion, Lisa Welchman, Kenneth Bowles, and Dan Rosenberg delved into the evolving role of designers in the age of AI, emphasizing ethical responsibility and the societal impact of design decisions. Kenneth Bowles highlighted the dual nature of responsibility in design—both backward-looking accountability and forward-looking duty—calling for designers to consider not just users but broader social and environmental stakeholders. Dan Rosenberg raised concerns about the ‘faith in the black box’ of AI and the upstream governance needed to prevent harm. The panelists debated the risk of AI commoditizing design roles and disintermediating human judgment. Lisa urged designers to assert agency, understand business deeply, and resist passivity, arguing for bolder engagement with tech’s ethical trajectories. They stressed that human judgment and empathy remain irreplaceable, especially in complex fields like healthcare. The importance of collaboration across silos and anticipatory design to manage AI’s unpredictable error states was also discussed. The panel concluded with encouragement to designers to deepen tech literacy, engage in ethical mitigation early, and shape AI’s future rather than passively accept it.

Key Insights

  • Design responsibility extends beyond users to society, environment, and the profession itself, demanding broader ethical consideration.

  • AI introduces a risk of commoditizing design work, particularly routine interface tasks that AI can automate within 12 to 36 months.

  • Human judgment remains critical and must not be ceded to AI, especially for discriminatory decisions and ethical complexities.

  • Understanding and linking design work to business strategy and value is essential for designers to maintain influence at the C-suite level.

  • Designers have significant agency but must proactively engage with AI technologies to shape their trajectory rather than resist passively.

  • Cross-disciplinary collaboration, especially between designers and data scientists, is necessary but challenged by entrenched organizational silos.

  • Designers should anticipate and design for AI error states, recognizing generative AI’s infinite unpredictability.

  • Techno-determinism is a pervasive risk; designers must challenge the inevitability mindset by actively influencing AI's ethical direction now.

  • Empathy and the embodied human experience are unique human factors that AI may fake but cannot replicate authentically.

  • Elevating UX roles upstream into product strategy and business leadership can help protect against devaluation due to AI automation.

Notable Quotes

"Designers have obligations not just to users but also to society and our own profession."

"We often point fingers at the person making the most money from the mess that designers put through the system."

"Faith in the black box makes me uneasy; as designers, we must care about what happens behind the scenes."

"I don’t think any designers today would hand over judgmental decisions fully to AI."

"If you don’t understand business, you don’t deserve a seat at the C-suite table."

"People remember how you made them feel, and that’s something AI can fake but not truly replicate."

"The risk is that AI will cut designers out of decision making because it’s perceived as cheaper or faster."

"Middle management often blocks collaboration despite desires from people underneath to work together."

"We need to design for the many error states generative AI can produce, however unpredictable."

"Technology does not have a mind of its own; people with power set its trajectory and we can influence that."

Ask the Rosenbot
Melinda Belcher
Insider preview of Enterprise Experience 2020
2020 • Enterprise Community
John Calhoun
Bring your DesignOps Story to Life! The Definitive DesignOps Book Jam
2023 • DesignOps Summit 2023
Gold
Rebecca Gimenez
Work in Progress: Service Design at Airbnb
2024 • Advancing Service Design 2024
Gold
Nicole Aleong
Future Orientations to Everyday Life: Futures Anthropology as a Methodology
2024 • Advancing Research 2024
Gold
Cara Maritz
The Art of Extrapolation
2023 • Advancing Research 2023
Gold
Scher Foord
Turn the Ship Around: How to Apply Design Thinking Across Your Organization
2021 • Design at Scale 2021
Gold
Aurobinda Pradhan
Introduction to Collaborative DesignOps using Cubyts
2022 • DesignOps Summit 2022
Gold
Frances Yllana
DesignOps–Leading the Path to Parity
2023 • DesignOps Community
Mary-Lynne Williams
Exit Interview #4: From Product Design Leadership to Sound Healing
2026 • Rosenfeld Community
Brenna Fallon
Learning Over Outcomes
2019 • DesignOps Summit 2019
Gold
Steve Krug
Don’t Make Me Think 3.0: What Endures and What Evolves in UX
2026 • Advancing Research 2026
Gold
Shivanjali M.
From Fragmented to Fluent: The Linguistic Approach to Research Knowledge
2026 • Rosenfeld Community
Megan Blocker
What UX research maturity looks like and how we get there [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Gabriela Barneva
Operationalizing Inclusive Design in Service Design
2025 • Advancing Service Design 2025
Gold
Zariah Cameron
ReDesigning Wellbeing for Equitable Care in the Workplace
2024 • DesignOps Summit 2024
Gold
Greg Petroff
Software as Material—A Redux
2023 • Enterprise UX 2023
Gold

More Videos

Sheri Byrne-Haber

"Getting something accessible is a straight line; keeping something accessible requires process change."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Prayag Narula

"The best products come from marrying analytics with human stories."

Prayag Narula Hannah Hudson

Empowering Designers to do Good Research

March 11, 2022

Janelle Estes

"When I first started, I felt like I had this little superpower that nobody else really knew about."

Janelle Estes

UX Research Trends

January 28, 2021

Craig Brookes

"Collaboration without ego is key to building the right product, not just what one's own interests are."

Craig Brookes Andreas Huebner Morgan Quinn

"Just Make it Look Good" and Other Ways We're Misunderstood

June 11, 2021

Marc Fonteijn

"If you don’t feel connected and you’re standing alone, the challenge looks much bigger."

Marc Fonteijn Ru Butler

Increase your confidence, influence, and impact (through a Professional Community)

December 3, 2024

Kate Towsey

"Engagement and impact roles bring creativity and help maintain team morale in otherwise dry operations work."

Kate Towsey

The State of ResearchOps: More Than Just Theory

June 20, 2019

Alla Weinberg

"Co-regulation means someone who is safe can help bring another out of a triggered state."

Alla Weinberg

Design Teams Need Psychological Safety: Here’s How to Create It

September 9, 2022

Shawna Hein

"The collaboration cycle requires following standards for accessibility, content, design system usage, and IA or you don’t launch your product."

Shawna Hein Kevin Hoffman

Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts

November 17, 2022

Tricia Wang

"Designing for marginalized communities often shows how to build scalable solutions with limited resources, saving money."

Tricia Wang

SCALE: Discussion

June 15, 2018