Day 2 Panel
Summary
In this panel discussion, Cheryl Kaba, Ethan Marotz, and Meena Previ reflect on the challenges and opportunities of designing with AI. Cheryl highlights the need to think beyond narrow AI use cases, stressing long-term impacts and ethical considerations, especially in education where AI might replace teachers. Ethan points to AI shifting design roles to supervisory or editorial, raising concerns about de-skilling and labor protections, drawing parallels to recent labor strikes in creative industries. Meena emphasizes ethical AI practices, co-creation with stakeholders, and transparency, cautioning against blind acceptance of AI outputs. Together, they explore the importance of intentionality, participatory design, and power dynamics in AI systems, noting capitalism’s role in shaping AI's adoption and urging designers to critically engage in shaping AI’s future. The panel also discusses transparency in AI confidence, ethical frameworks beyond compliance, and the lifecycle of AI hype. They close with calls for conversations among coworkers about AI’s role, and critical questioning of who designs AI and for whom, advocating sustained reflection on AI's social and labor impacts.
Key Insights
-
•
AI design is currently in an experimental stage, often focused on narrow use cases rather than broad impacts.
-
•
The shift to AI often changes designers' roles from creators to supervisors, potentially leading to workforce de-skilling.
-
•
Ethical AI practices require active inclusion of marginalized groups in the design and feedback processes.
-
•
Transparency about AI confidence levels has decreased in modern chatbots, complicating trust and interpretation.
-
•
Designers must balance augmentation and automation carefully to avoid disempowerment and job losses.
-
•
Power dynamics are central to AI system design; systems should promote empowerment rather than control.
-
•
Sustainability and AI's environmental impact are often overlooked in technology discussions.
-
•
Ethical frameworks vary and should be adapted to specific communities and organizational goals rather than treated as universally equal.
-
•
Labor movements and unionization are relevant lenses to consider protections against AI-driven labor changes.
-
•
Effective AI integration requires intentional conversations and collective reflection among workplace stakeholders.
Notable Quotes
"We’re in this initial stage of tinkering, just trying to make the tech behave the way we expect it to."
"AI moves the practitioner into an editorial or supervisory role, which often signals de-skilling."
"We want AI to augment human skills like an electric bike, not replace them like a robotic vacuum cleaner."
"Who is designing these AI systems, why, and for whom? Are those most impacted even involved?"
"Designers need to have critical conversations with stakeholders about the direction and impacts of AI."
"Ethics is not just about compliance; it’s about doing the right thing holistically."
"Most people’s fears about AI are actually fears about capitalism."
"Transparency of AI’s confidence has mostly disappeared because generative AI is inherently confident by design."
"AI tools today are sandwiches in search of picnics—useful, but lacking killer applications yet."
"We need to redesign capitalism, but right now we don’t have time for that."
Or choose a question:
More Videos
"Averages are an enemy; segmenting reveals the true nature of customer intent and sentiment."
Jill FruchterInconvenient Insights: The Researcher's Role is to Stay Curious
March 29, 2023
"Accessibility used to be considered an inspiring hack, something available only to the lucky few."
Sam ProulxTo Boldly Go: The New Frontiers of Accessibility
November 18, 2022
"Designing for the real world means dealing with practical constraints and making refinements in the face of compromise."
Craig VillamorResilient Enterprise Design
June 8, 2017
"We're structured like a dry cleaner—someone only thinks about research when they have a problem to solve."
Tala Tayebi Kelly Goto Jared SpoolVoice and influence in an age of noise
March 10, 2026
"Linear notes are fixed hierarchically and chronologically, making it hard to find patterns across ideas."
Jorge ArangoExploding the Notebook: How to Unlock the Power of Linked Notes (2nd of 3 seminars)
April 19, 2024
"A prototype is worth a thousand meetings."
Alnie FigueroaTeamwork: Strategies for Effective Collaboration with Other Program Management Teams
September 8, 2022
"There are allies everywhere, even in unexpected places inside your organization."
Leah Buley Joe NatoliAsk Me Anything with Leah Buley and Joe Natoli, co-authors of The User Experience Team of One (2nd edition)
October 8, 2024
"We need to turn our skills toward observing the culture of the companies we’re in."
Christopher GeisonTheme 1 Intro
March 25, 2024
"Measuring wrong can cost you half a billion dollars, but also what you measure and how you measure matters a lot."
John Calhoun Rachel PosmanMeters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
September 24, 2024
