Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

“Feels Like Paper!”: Interfacing AI through Paper

Gold
Wednesday, June 11, 2025 • Designing with AI 2025

This video is featured in the Designing with AI 2025 playlist and 1 more.

Share the love for this talk
“Feels Like Paper!”: Interfacing AI through Paper
Speakers: Lukas Moro
Link:

Summary

“Feels Like Paper!” is a series of prototypes about augmenting physical paper through AI. Various ML models, LLMs and a mixed reality headset are used to infuse physical paper and ink with properties of the digital world without compromising on their physical traits.

Key Insights

  • Physical paper retains unique tactile qualities that people naturally gravitate toward for reading, writing, and drawing.

  • Augmented reality can augment handwriting math input and provide instant, contextual AI-generated answers projected close to the user’s writing.

  • Mixed reality interfaces enable a tight coupling between physical and virtual objects, making digital content feel part of the physical world with shadow and spatial alignment.

  • AI agents embodied in physical objects scattered in our environment offer localized, context-aware assistance rather than a single all-knowing AI entity.

  • Designing AI interfaces means designing for variable behaviors, as AI outputs are not deterministic and can change with context and prompts.

  • Embodied interfaces can sometimes function without visible augmentation, using physical actions like highlighting combined with speech to synchronize digital data.

  • Real-time image diffusion used as a co-creative muse on physical drawings creates a hierarchical relationship where AI inspires but does not dictate final outcomes.

  • Smart glasses with egocentric cameras offer new opportunities for natural interaction but raise significant privacy concerns that need careful attention.

  • Interaction choreography and microgestures are critical for socially acceptable use of smart glasses in public or professional environments.

  • Future interfaces may allow uninterrupted coexistence of physical and virtual content on a single perceptual layer, enhancing sensory saturation and collaboration.

Notable Quotes

"Conventional user interfaces have a very low rate of information exchange between the user and the technology."

"Augmenting our sensors through AI becomes possible with increasingly egocentric perspectives on the user’s context."

"The interaction comes to the foreground mainly when there’s a negotiation of intentionality between the user and the technology."

"Physical paper has a special tactility to it; people still gravitate back to it because of this nature."

"It is very important to be aware of augmentations because otherwise they can feel very intrusive to the user."

"There is a tight coupling of physical and digital objects that makes the physical world more fluid and the virtual world gain physical traits."

"With Draw Dream, the AI acts as a muse, giving inspiration but not the final outcome."

"Realtime model feedback on egocentric inputs really feels like lucid dreaming."

"Designing for AI means designing for behavior because you will not always get the same result for the same question."

"We need to factor in the specifics of the social situation when designing interaction models and gestures for smart glasses."

Ask the Rosenbot
Renee Reid
Becoming a ResearchH.E.R (Highly Enterprise Ready)
2019 • Enterprise Experience 2019
Gold
Nick Cochran
Growing in Enterprise Design through Making Connections
2019 • Enterprise Experience 2019
Gold
Kyria Stephens
Power to Heal: Civic Design in the Aftermath of Tragedy
2022 • Civic Design 2022
Gold
Neema Mahdavi
Operationalizing DesignOps
2018 • DesignOps Summit 2018
Gold
Jonathan Fairman
Integrating generative AI into enterprise products: A case study from dscout
2024 • Designing with AI 2024
Gold
Husani Oakley
Theme Three Intro
2023 • Enterprise UX 2023
Gold
Kristin Skinner
8 Types of Measures in Design Operations
2020 • DesignOps Community
Kristen Guth, Ph.D.
Out of the FOG: A Non-traditional Research Approach to Alignment
2023 • Advancing Research 2023
Gold
Aditi Ruiz
A PM State of Mind: Empathy Mapping Your Product Manager, Pt. 1
2022 • Design in Product 2022
Gold
Sara Conklin
A UXer’s 12-Month Journey from Climate Concern to Climate Credibility
2025 • Climate UX Interest Group
Brennan Hartich
Communicating and Establishing DesignOps as a New Function
2018 • DesignOps Summit 2018
Gold
Daniel Gloyd
Designing Warmth
2025 • Rosenfeld Community
George Abraham
Design Systems To-Go: Reimagining Developer Handoff, and Introducing App Builder (Part 2)
2021 • DesignOps Summit 2021
Gold
Alana Washington
(Remote) Service Design: A Transformation Case Study
2022 • Design at Scale 2022
Gold
Uday Gajendar
Theme One Intro
2023 • Enterprise UX 2023
Gold
Ned Dwyer
The Future of DesignOps is Tool Consolidation
2024 • DesignOps Summit 2024
Gold

More Videos

Sheri Byrne-Haber

"Either you need accessibility now or you will need accessibility in the future."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Prayag Narula

"Most users don't know what they want until you show it to them."

Prayag Narula Hannah Hudson

Empowering Designers to do Good Research

March 11, 2022

Janelle Estes

"Inclusive research means building for diverse people, not just for ourselves or a narrow segment."

Janelle Estes

UX Research Trends

January 28, 2021

Craig Brookes

"Content design is nascent and often misunderstood, but embedding content designers improves product clarity and usability."

Craig Brookes Andreas Huebner Morgan Quinn

"Just Make it Look Good" and Other Ways We're Misunderstood

June 11, 2021

Marc Fonteijn

"Everyone goes through quite an extensive application process, but it was stress-free and informal."

Marc Fonteijn Ru Butler

Increase your confidence, influence, and impact (through a Professional Community)

December 3, 2024

Kate Towsey

"You cannot provide end-to-end service for every researcher, but you can deliver highly supported self-service — Kate Towsey."

Kate Towsey

The State of ResearchOps: More Than Just Theory

June 20, 2019

Alla Weinberg

"If I make a mistake on our team, it’s not gonna be held against me; my team won’t disconnect from me."

Alla Weinberg

Design Teams Need Psychological Safety: Here’s How to Create It

September 9, 2022

Shawna Hein

"We treat our shared tooling and design system as a product with a dedicated team maintaining reusable components and governance."

Shawna Hein Kevin Hoffman

Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts

November 17, 2022

Tricia Wang

"You have to look two or three steps ahead so you're not chasing what's right in front of you — avoid target fixation."

Tricia Wang

SCALE: Discussion

June 15, 2018