Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Designing Within the Lines: How the EU AI Act Can Spark Better AI Innovation

Thursday, December 11, 2025 • DesignOps Community
Share the love for this talk
Designing Within the Lines: How the EU AI Act Can Spark Better AI Innovation
Speakers: Patrizia Bertini
Link:

Summary

Are you building or using AI in your products? Do you have customers in the EU, or plan to? If so, the EU AI Act isn’t just another piece of legislation. It’s a blueprint for the future of digital product design, a signal of where responsible, human-centered technology is headed. As the world’s first comprehensive AI law, the Act sets new expectations for trust, transparency, and accountability. And it doesn’t matter whether your team is in San Francisco, Singapore, or Sydney: if you build or use AI, this shift affects you. Let’s stop treating AI like a race, and start seeing it as a design challenge: how to build products that people trust, adopt, and keep using. From chatbots to recommendation engines, every AI-powered experience will soon need to meet standards for safety, explainability, and fairness. But this isn’t only about compliance. It’s about turning responsibility into a competitive edge, building systems that last, and products that lead. In this session, we’ll unpack what the EU AI Act means for design, product, and operations leaders, in plain language, no legal jargon required. You’ll walk away understanding: - How AI systems are classified and why “high risk” might apply to your product even if you’re not in the EU - Why transparency, documentation, and human oversight are becoming core design principles - How acting early can strengthen user trust, reduce risk, and set your team apart - How design and product roles are evolving and why that shift is an opportunity, not a threat This isn’t about avoiding fines. It’s about leading with integrity, designing technology people believe in, and using regulation as a launchpad for innovation. Whether you’re a designer, product manager, or operations leader, this session will help you understand what’s changing, take action now, and turn the EU AI Act into your next innovation catalyst.

Key Insights

  • The EU AI Act introduces penalties up to 35 million euros or 7% of global turnover for non-compliance, affecting any company serving European customers.

  • AI is agency with impact, not just a tool; it can make decisions dramatically affecting human lives.

  • Transparency and accountability are core to the AI Act, requiring detailed documentation and auditable logs of all AI decisions, preserved for up to 10 years.

  • High-risk AI systems, such as those used in healthcare or hiring, require bias testing, human oversight, and clear escalation paths.

  • Many current AI systems cannot be retrofitted to comply, making early compliance and documentation essential.

  • Chatbots are generally low or limited risk but become high risk if their decisions significantly impact humans, such as insurance claims denial.

  • Synthetic content generated or altered by AI must be persistently labeled as such to maintain transparency for users and auditors.

  • Human oversight must prevail in AI interactions; humans retain accountability and must be able to override AI decisions.

  • Designers need to create flows that embed human control, transparency, and accountability, moving beyond traditional user flows to 'agent flows' managing AI interactions.

  • Organizations should map their AI systems, classify risk levels, assign responsibility, and prioritize compliance as part of their product strategies.

Notable Quotes

"The AI Act can spark better innovation with AI rather than constraining it."

"Speed is not everything we need velocity—speed plus direction is key."

"AI is not a tool. AI has agency. AI makes decisions that impact people's lives."

"Machines cannot be accountable; responsibility is always human."

"If you are building or deploying AI that impacts people, you need to document everything."

"Transparency requires all decisions to be clear and understandable to non-technical users."

"Humans need to override and dominate AI because machines have no context or experience."

"Most AI systems today cannot be retrofitted easily to comply with regulation."

"Everything touched by AI becomes synthetic and needs persistent labeling."

"Real innovation is not being first; it's about doing it right and sustainably."

Ask the Rosenbot
Product and Design at Bloomberg: A 15-year Evolution
2022 • Design in Product 2022
Gold
Greg Petroff
Design is the Differentiator: Bringing New Design Innovations to a Very Antiquated and Very Large Industry
2021 • Design at Scale 2021
Gold
Chris Govias
Perspectives on Civic Design
2021 • Civic Design Community
Dem Gerolemou
Climate technology fundamentals
2024 • Climate UX Interest Group
Daniel Gloyd
Designing From the Inside Out: How Method Acting Can Inspire Design Research
2026 • Rosenfeld Community
Louis Rosenfeld
The Bigger Picture: A Panel Discussion
2019 • DesignOps Summit 2019
Gold
Laura Klein
Human vs. machine: Testing AI’s ability to synthesize and analyze research
2026 • Advancing Research 2026
Gold
Megan Clegg
Space for Everyone: Reframing Accessibility Through a Wider Lens
2021 • Design at Scale 2021
Gold
Jemma Ahmed
Democratization: Working with it, not against it [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • Civic Design 2022
Gold
Tara Tressel
Investigating qualitative depth of AI-moderated interviews
2026 • Advancing Research 2026
Gold
Shipra Kayan
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
2021 • DesignOps Summit 2021
Gold
Niko Laitinen
Adaptable Org Design for Resilient Times
2021 • Design at Scale 2021
Gold
Susan Simon-Daniels
War Stories LIVE! Susan Simon-Daniels
2020 • Advancing Research 2020
Gold
Benjamin Real
Showing the Value of DesignOps by Not Having a DesignOps Team
2020 • DesignOps Summit 2020
Gold
Tiffany Cheng
Designing in a Pandemic: Integrating Speed and Rigor
2022 • Design at Scale 2022
Gold

More Videos

Sheri Byrne-Haber

"Getting something accessible is a straight line; keeping something accessible requires process change."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Prayag Narula

"Empathy isn't just kindness, it's the lens through which we see users' true motivations."

Prayag Narula Hannah Hudson

Empowering Designers to do Good Research

March 11, 2022

Janelle Estes

"The hardest skill to recruit for is someone who can consult and ask the right questions to uncover what the request really is."

Janelle Estes

UX Research Trends

January 28, 2021

Craig Brookes

"User research is a validation function is a common pitfall, but its real power is uncovering meaningful insights early."

Craig Brookes Andreas Huebner Morgan Quinn

"Just Make it Look Good" and Other Ways We're Misunderstood

June 11, 2021

Marc Fonteijn

"High quality personal connections mean you can engage on a level playing field with serious professionals."

Marc Fonteijn Ru Butler

Increase your confidence, influence, and impact (through a Professional Community)

December 3, 2024

Kate Towsey

"It’s challenging scaling a team with limited resources to provide comprehensive coverage to a fast-growing research function — Tim Toy, Airbnb."

Kate Towsey

The State of ResearchOps: More Than Just Theory

June 20, 2019

Alla Weinberg

"Co-regulation means someone who is safe can help bring another out of a triggered state."

Alla Weinberg

Design Teams Need Psychological Safety: Here’s How to Create It

September 9, 2022

Shawna Hein

"We have over 30 contracting teams spread across roughly 10 vendors all working on parts of the veteran experience landscape."

Shawna Hein Kevin Hoffman

Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts

November 17, 2022

Tricia Wang

"Being comfortable with discomfort is key — if someone tells me I'm wrong, I'm okay with that."

Tricia Wang

SCALE: Discussion

June 15, 2018