Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Designing Within the Lines: How the EU AI Act Can Spark Better AI Innovation

Thursday, December 11, 2025 • DesignOps Community
Share the love for this talk
Designing Within the Lines: How the EU AI Act Can Spark Better AI Innovation
Speakers: Patrizia Bertini
Link:

Summary

Are you building or using AI in your products? Do you have customers in the EU, or plan to? If so, the EU AI Act isn’t just another piece of legislation. It’s a blueprint for the future of digital product design, a signal of where responsible, human-centered technology is headed. As the world’s first comprehensive AI law, the Act sets new expectations for trust, transparency, and accountability. And it doesn’t matter whether your team is in San Francisco, Singapore, or Sydney: if you build or use AI, this shift affects you. Let’s stop treating AI like a race, and start seeing it as a design challenge: how to build products that people trust, adopt, and keep using. From chatbots to recommendation engines, every AI-powered experience will soon need to meet standards for safety, explainability, and fairness. But this isn’t only about compliance. It’s about turning responsibility into a competitive edge, building systems that last, and products that lead. In this session, we’ll unpack what the EU AI Act means for design, product, and operations leaders, in plain language, no legal jargon required. You’ll walk away understanding: - How AI systems are classified and why “high risk” might apply to your product even if you’re not in the EU - Why transparency, documentation, and human oversight are becoming core design principles - How acting early can strengthen user trust, reduce risk, and set your team apart - How design and product roles are evolving and why that shift is an opportunity, not a threat This isn’t about avoiding fines. It’s about leading with integrity, designing technology people believe in, and using regulation as a launchpad for innovation. Whether you’re a designer, product manager, or operations leader, this session will help you understand what’s changing, take action now, and turn the EU AI Act into your next innovation catalyst.

Key Insights

  • The EU AI Act introduces penalties up to 35 million euros or 7% of global turnover for non-compliance, affecting any company serving European customers.

  • AI is agency with impact, not just a tool; it can make decisions dramatically affecting human lives.

  • Transparency and accountability are core to the AI Act, requiring detailed documentation and auditable logs of all AI decisions, preserved for up to 10 years.

  • High-risk AI systems, such as those used in healthcare or hiring, require bias testing, human oversight, and clear escalation paths.

  • Many current AI systems cannot be retrofitted to comply, making early compliance and documentation essential.

  • Chatbots are generally low or limited risk but become high risk if their decisions significantly impact humans, such as insurance claims denial.

  • Synthetic content generated or altered by AI must be persistently labeled as such to maintain transparency for users and auditors.

  • Human oversight must prevail in AI interactions; humans retain accountability and must be able to override AI decisions.

  • Designers need to create flows that embed human control, transparency, and accountability, moving beyond traditional user flows to 'agent flows' managing AI interactions.

  • Organizations should map their AI systems, classify risk levels, assign responsibility, and prioritize compliance as part of their product strategies.

Notable Quotes

"The AI Act can spark better innovation with AI rather than constraining it."

"Speed is not everything we need velocity—speed plus direction is key."

"AI is not a tool. AI has agency. AI makes decisions that impact people's lives."

"Machines cannot be accountable; responsibility is always human."

"If you are building or deploying AI that impacts people, you need to document everything."

"Transparency requires all decisions to be clear and understandable to non-technical users."

"Humans need to override and dominate AI because machines have no context or experience."

"Most AI systems today cannot be retrofitted easily to comply with regulation."

"Everything touched by AI becomes synthetic and needs persistent labeling."

"Real innovation is not being first; it's about doing it right and sustainably."

Ask the Rosenbot
Kristin Taylor
Building Bridges Across Organizational Silos
2022 • Civic Design 2022
Gold
Xenia Adjoubei
Empowering Communities Through the Researcher in Residence Program
2023 • Advancing Research 2023
Gold
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Advancing Research 2022
Gold
Jeff Sussna
What DesignOps Can Learn From DevOps
2017 • DesignOps Summit 2017
Gold
Alla Weinberg
Design Teams Need Psychological Safety: Here’s How to Create It
2022 • DesignOps Summit 2022
Gold
Kelly Dern
AI as a Design Partner: How to Get the Most Out of AI Tools to Scale Your Process
2023 • DesignOps Summit 2023
Gold
Rusha Sopariwala
Remote, Together: Craft and Collaboration Across Disciplines, Borders, Time Zones, and a Design Org of 170+
2022 • Design at Scale 2022
Gold
Kritika Yadav
Optimizing AI Conversations: A Case Study on Personalized Shopping Assistance Frameworks
2025 • Designing with AI 2025
Gold
Sharbani Dhar
Breathing Room for Delight
2024 • Enterprise Experience 2020
Gold
JJ Kercher
A Roadmap for Maturing Design in the Enterprise
2018 • Enterprise Experience 2018
Gold
Dan Donald
Design Systems as a Vehicle for Systemic Change
2023 • DesignOps Community
Ted Booth
Discussion
2016 • Enterprise UX 2016
Gold
Yunyan Li
UX Best Practices
2021 • Design at Scale 2021
Gold
Jose Coronado
People First - Design at JP Morgan
2021 • Design at Scale 2021
Gold
Greg Petroff
Design is the Differentiator: Bringing New Design Innovations to a Very Antiquated and Very Large Industry
2021 • Design at Scale 2021
Gold
Robert Fabricant
Industry junctures: Paths forwards for UXR and the critical decisions that get us there [Advancing Research Community Workshop Series]
2024 • Advancing Research Community

More Videos

Rebecca Gimenez

"If you ask our partners what we do, they might say I’m not totally sure, but I know that we need it."

Rebecca Gimenez

Work in Progress: Service Design at Airbnb

December 3, 2024

Lada Gorlenko

"Designers can be first responders, not just in digital but in real disaster situations."

Lada Gorlenko

Theme 2 Intro

June 9, 2022

Brigette Metzler

"Researchers are often nervous about their research being used in the wrong way, so trust and communication matter."

Brigette Metzler Dana Chrisfield

Research Repositories: A global project by the ResearchOps Community

August 27, 2020

"Find an unindicted co-conspirator in your company with a problem you can help solve, and the rest will follow."

Discussion

June 9, 2017

Sarah Brooks

"Designing a service is really designing a new relationship between government and people, who come with enormous baggage."

Sarah Brooks Jennifer Pahlka

Fireside chat with Sarah Brooks and Jen Pahlka

October 21, 2021

Lisa Spitz

"We constantly analyze our recruitment data and note that we still struggle to reach Hispanic or Latino origin individuals, older adults, and lower-income participants."

Lisa Spitz Nikki Brand

Building Trust Through Equitable Research Practices

November 18, 2022

Theresa Neil

"You aren't going to understand the healthcare ecosystem right off the bat; it’s incredibly complex."

Theresa Neil

Designing for Wellness: Specializing in Healthcare

May 22, 2024

Maverick Chan

"Cursor is super transparent about what files it creates and how it builds the logic step by step."

Maverick Chan Claire Lin

From Doodle to Demo: AI as Our Storytelling Partner

October 23, 2025

Alla Weinberg

"Safety is a state of our nervous system, not simply a feeling or relationship."

Alla Weinberg

Design Teams Need Psychological Safety: Here’s How to Create It

September 8, 2022