Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
When AI Agents Meet Reality. Service Design Lessons from a Pilot
Summary
Why does the introduction of AI agents so often lead to confusion instead of clarity? Drawing on an applied pilot project on Human-Agent Teams, this session shares key learnings from integrating AI agents into everyday work. The focus is not on the technology itself, but on structure. How roles shift. Where decisions get stuck. How trust is shaped or undermined. And why teams struggle even when the system technically works. The session shows how Service Design helped make these dynamics visible and manageable. Not as a creativity method, but as a way to design clear responsibility, decision paths, and collaboration between humans and agents. Presentation and discussion.
Key Insights
-
•
Agentic AI represents a shift from AI as a tool to AI as autonomous collaborators that run background workflows.
-
•
Many organizations have AI agents built, but a large gap remains in making them truly helpful and valuable.
-
•
Service design methods like process blueprints and human-in-the-loop approaches are key to designing effective AI-human workflows.
-
•
Building AI agents quickly is easy, but identifying where they add value requires deep problem understanding and organizational context.
-
•
Chaos in undocumented or inconsistent workflows complicates designing useful AI workflows.
-
•
Trust and responsibility must remain human-led with clear definitions of when and how humans intervene in AI processes.
-
•
Organizational power dynamics around information sharing critically impact the effectiveness of AI agent deployment.
-
•
Iterative quality feedback loops where AI agents improve based on continuous human input are vital for success.
-
•
Co-creative, multidisciplinary engagement including non-technical stakeholders increases adoption and reduces resistance to AI.
-
•
AI literacy at all organizational levels is necessary; leaders must engage with AI to properly support teams using it.
Notable Quotes
"Before for me, AI was just a tool, but now these agents are running in the background and are mostly invisible, changing everything."
"Lots of people have agents running, but they don't feel they’re really useful yet."
"It’s not about pure automation. It's like playing tennis—back and forth between human and agent."
"We must design who is in the loop and who is in the lead. The responsibility can’t be handed over to AI."
"If you spend more time building an agent than doing the task, it’s not worth it."
"The chaos of undocumented processes makes it hard to build useful AI workflows; mapping and blueprinting help."
"Information is power in organizations, so deploying AI agents means reconsidering who gets access to what data."
"It’s dangerous to believe everything AI says or to believe nothing. We must find a balance."
"You can't delegate AI decisions to IT alone; every team needs to figure out how AI agents support their work."
"If we don't do hard thinking and critical collaboration when building agents, we’ll end up with armies of unused agents."
Or choose a question:
More Videos
"We’re lucky if we solve a single thing; everything else has to be parking lot."
Jon Fukuda Amy Evans Ignacio Martinez Joe MeersmanThe Big Question about Innovation: A Panel Discussion
September 25, 2024
"Thinking about accessibility is really thinking about creating technology that works for all people all the time."
Sam ProulxAccessibility: An Opportunity to Innovate
March 9, 2022
"Diversity means who is in the room, equity asks who wants to or should be in the room but isn’t, and inclusion asks have everybody’s ideas been heard."
Anna Avrekh Amy Jiménez Márquez Morgan C. Ramsey Catarina TsangDiversity In and For Design: Building Conscious Diversity in Design and Research
June 9, 2021
"You gotta assume your bot is going to fail and design from zero."
Greg NudelmanDesigning Conversational Interfaces
November 14, 2019
"You get real coded components, not just HTML snippets or style attributes, meaning developers can drag, drop, and extend with hooks already in place."
George Abraham Stefan IvanovDesign Systems To-Go: Reimagining Developer Handoff, and Introducing App Builder (Part 2)
October 1, 2021
"Synthetic data created by AI—like fake personas and journeys—is super derivative and often not insightful."
Shipra KayanMake your research synthesis speedy and more collaborative using a canvas
January 24, 2025
"If something is only visible on hover, it either needs to be visible to screen readers at all times or have an alternative way to access it."
Sam ProulxDesigning For Screen Readers: Understanding the Mental Models and Techniques of Real Users
December 10, 2021
"We moved from Evernote to spreadsheets, to a giant affinity board in Mirror, then to UserVoice, and finally to idiomatic software with AI."
Shipra KayanHow we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
September 30, 2021
"For some users, AI products are not just tools, they are relationships."
Dane DeSutterKeeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
March 26, 2024
Latest Books All books
Dig deeper with the Rosenbot
Why is the timeline important when creating a product vision, and what is a realistic timeframe?
How do I determine the shelf life or expiry date of different types of research insights?
How can teams create lightweight visibility systems that improve workload transparency without reducing productivity?