Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Day 1 Panel

Gold
Tuesday, June 4, 2024 • Designing with AI 2024
Share the love for this talk
Day 1 Panel
Speakers: Cennydd Bowles , Dan Rosenberg and Lisa Welchman
Link:

Summary

In this panel discussion, Lisa Welchman, Kenneth Bowles, and Dan Rosenberg delved into the evolving role of designers in the age of AI, emphasizing ethical responsibility and the societal impact of design decisions. Kenneth Bowles highlighted the dual nature of responsibility in design—both backward-looking accountability and forward-looking duty—calling for designers to consider not just users but broader social and environmental stakeholders. Dan Rosenberg raised concerns about the ‘faith in the black box’ of AI and the upstream governance needed to prevent harm. The panelists debated the risk of AI commoditizing design roles and disintermediating human judgment. Lisa urged designers to assert agency, understand business deeply, and resist passivity, arguing for bolder engagement with tech’s ethical trajectories. They stressed that human judgment and empathy remain irreplaceable, especially in complex fields like healthcare. The importance of collaboration across silos and anticipatory design to manage AI’s unpredictable error states was also discussed. The panel concluded with encouragement to designers to deepen tech literacy, engage in ethical mitigation early, and shape AI’s future rather than passively accept it.

Key Insights

  • Design responsibility extends beyond users to society, environment, and the profession itself, demanding broader ethical consideration.

  • AI introduces a risk of commoditizing design work, particularly routine interface tasks that AI can automate within 12 to 36 months.

  • Human judgment remains critical and must not be ceded to AI, especially for discriminatory decisions and ethical complexities.

  • Understanding and linking design work to business strategy and value is essential for designers to maintain influence at the C-suite level.

  • Designers have significant agency but must proactively engage with AI technologies to shape their trajectory rather than resist passively.

  • Cross-disciplinary collaboration, especially between designers and data scientists, is necessary but challenged by entrenched organizational silos.

  • Designers should anticipate and design for AI error states, recognizing generative AI’s infinite unpredictability.

  • Techno-determinism is a pervasive risk; designers must challenge the inevitability mindset by actively influencing AI's ethical direction now.

  • Empathy and the embodied human experience are unique human factors that AI may fake but cannot replicate authentically.

  • Elevating UX roles upstream into product strategy and business leadership can help protect against devaluation due to AI automation.

Notable Quotes

"Designers have obligations not just to users but also to society and our own profession."

"We often point fingers at the person making the most money from the mess that designers put through the system."

"Faith in the black box makes me uneasy; as designers, we must care about what happens behind the scenes."

"I don’t think any designers today would hand over judgmental decisions fully to AI."

"If you don’t understand business, you don’t deserve a seat at the C-suite table."

"People remember how you made them feel, and that’s something AI can fake but not truly replicate."

"The risk is that AI will cut designers out of decision making because it’s perceived as cheaper or faster."

"Middle management often blocks collaboration despite desires from people underneath to work together."

"We need to design for the many error states generative AI can produce, however unpredictable."

"Technology does not have a mind of its own; people with power set its trajectory and we can influence that."

Ask the Rosenbot
Aditi Ruiz
A PM State of Mind: Empathy Mapping Your Product Manager, Pt. 1
2022 • Design in Product 2022
Gold
Chris Engledowl
A Mixed Method Approach to Validity to Help Build Trust
2023 • QuantQual Interest Group
Sarit Geertjes
People, not Petri Dishes: Stories from a Research Recruiter
2019 • DesignOps Community
Greg Petroff
Everything is About to Change: Software as Material
2016 • Enterprise UX 2016
Gold
Dr. Jamika D. Burge
Advancing the Inclusion of Womxn in Research Practices
2022 • Advancing Research Community
Lavrans Løvlie
Ask me anything – Authors of Service Design: From Insight to Implementation
2025 • Advancing Service Design 2025
Gold
Margot Bloomstein
Fostering Trust in Your Brand and Beyond
2020 • Enterprise Community
Andreas Huebner
What Is It Like To Be Part of The UX Team at Compass?
2021 • Advancing Research 2021
Gold
Ellen Chisa
The Values of Design
2023 • Design in Product 2023
Gold
Husani Oakley
Theme Two Intro
2023 • Enterprise UX 2023
Gold
Aiyana Bodi
Three Key Climate Initiatives and How You Can Help
2024 • Climate UX Interest Group
Laureen Kattan
Centering Patients and Clinicians in a Complex Government Ecosystem
2023 • Design in Product 2023
Gold
Corey Long
Hiring in DesignOps: A Critical Study on How to Hire and Get Hired
2024 • DesignOps Summit 2024
Gold
Maverick Chan
From Doodle to Demo: AI as Our Storytelling Partner
2025 • Rosenfeld Community
Louis Rosenfeld
GenAI for UXers: A Rosenbot Demo and Discussion
2025 • Designing with AI 2025
Gold
Tanya Snook
Designing the team experience: Building culture through onboarding
2021 • Enterprise Community

More Videos

Greg Petroff

"There’s a new tech stack for software creation, all about cloud services and subscription-based business models."

Greg Petroff

Software as Material—A Redux

June 6, 2023

Brendan Jarvis

"They walked. The locals were most likely right."

Brendan Jarvis

Framing Tomorrow by Questioning Today

June 8, 2022

Prerna Makanawala

"Achieving coherency across products leads to less training, fewer support calls, and more users successfully adopting products."

Prerna Makanawala

Achieving Balanced Design Consistency

June 9, 2021

Tricia Wang

"Researchers might be the last people in organizations accountable for understanding humans."

Tricia Wang

From Users to Shapers of AI: The Future of Research

March 25, 2024

Cheryl Platz

"Not all monetization is equal; pay-to-express models are less threatening to social dynamics than pay-for-power schemes."

Cheryl Platz

Embrace Your Fun Factor: Game Development Best Practices for Product Design

January 9, 2026

Ariel Kennan

"We want to deepen equity and care in how we work, who we do it with, and the output and impact it generates."

Ariel Kennan

Theme Two Intro

November 17, 2022

Tricia Wang

"Building trust across functions means simple acts like scheduling lunch or coffee meetings with no agenda."

Tricia Wang

The most popular design thinking strategy is BS

January 27, 2022

Kristin Wisnewski

"This circle represents the size of IBM, 385,000 IBMers. The CIO team is only 3% of that, and our design team is just 1% of the CIO."

Kristin Wisnewski

Measuring What Matters

October 23, 2019

Scott Jensen

"It became less important to keep doing fresh research and more important to grow the collective team knowledge."

Scott Jensen Sarah Delaney Carmen Liu

Short Take #2: UX/Product Lessons from Your Industry Peers

December 6, 2022