Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Who does the math: A designer’s journey in building an AI-based tutoring app

Gold
Tuesday, June 10, 2025 • Designing with AI 2025

This video is featured in the Designing with AI 2025 playlist.

Share the love for this talk
Who does the math: A designer’s journey in building an AI-based tutoring app
Speakers: Aras Bilgen
Link:

Summary

We built a novel math tutoring app for 11-year-olds in the UK. Since this was our first AI project, we expected lots of technical issues. Those happened and on top of it, we ended up questioning the value of designers in AI-driven products.

Key Insights

  • Designing AI products demands a strong understanding of AI’s inner workings to anticipate challenges and create meaningful alternatives.

  • AI model updates can unpredictably impact performance, requiring flexible design solutions and rapid iteration.

  • The Boost 11 Plus app used photography and step-by-step AI tutoring to assist stressed students and their families effectively.

  • Strict SLAs, like 24-hour design comment turnarounds, help teams manage rapid changes and keep alignment in AI projects.

  • Design principles such as avoiding gamification and clarifying the app is a calculator, not a person, were crucial to maintaining ethical clarity.

  • Designers face loss of traditional precision and predictability when designing with large language models due to their inherent opacity.

  • Rapid AI advances demand constant adaptation; designers must create multiple design alternatives to navigate ambiguity.

  • The plastics analogy illustrates how shiny new technologies can deliver powerful capabilities but carry unforeseen long-term harms and ethical risks.

  • AI’s environmental cost, like energy use for generating content, is significant and often overlooked in design and deployment choices.

  • AI systems can diminish critical cognitive skills like memory and critical thinking, highlighting the need for mindful usage and design.

Notable Quotes

"The app reads the question and prepares tutoring material, then helps solve it step by step or through chat if further questions remain."

"We realized designing for AI is very different from other computational mediums we used before."

"Understanding the lifecycle of AI code is essential because AI is essentially code running in constant evolution."

"With LLMs, precision is not possible; no one really knows why it decided what to say."

"AI is like plastics on the surface — it gives amazing powers but has hidden damages we must not repeat."

"Design is an excellent way to navigate chaos, turning ambiguity into direction through alternatives."

"We used design principles like look but don't copy, this is a calculator not a person, and no gamification to guide tough decisions."

"AI companies focus on the shiniest thing that comes without caring about stability or reliability."

"It costs about as much as a bottle of water in energy to generate a single email from an LLM system."

"AI users have reduced critical thinking skills within just two years of using AI-assisted tools."

Ask the Rosenbot
Bria Alexander
Day 2 Welcome
2024 • DesignOps Summit 2024
Gold
George Abraham
Design Systems To-Go: Introducing a Starter Design System, and Indigo.Design Overview (Part 1)
2021 • DesignOps Summit 2021
Gold
Marc Majers
Interrupted UX - Add A Dose of Reality To Usability Testing
2022 • Advancing Research 2022
Gold
Stephen Anderson
Puzzled? How to Coordinate Humans for Complex Challenges
2021 • Enterprise Community
Daniel Korczynski
From generic to contextual research insights with AI | Live Q&A
2026 • Advancing Research 2026
Gold
Jennifer Strickland
Adopting a "Design By" Method
2021 • Civic Design 2021
Gold
Bria Alexander
Theme Two Intro
2022 • DesignOps Summit 2022
Gold
Saskia Liebenberg
Start Small for Big Impact
2019 • DesignOps Community
Richard Buchanan
Creativity and Principles in the Flourishing Enterprise
2018 • Enterprise Experience 2018
Gold
Johanna Kollmann
Insights-Driven Product Strategy: Get your Research to Count
2022 • Design in Product 2022
Gold
Leah Buley
Ask Me Anything with Leah Buley and Joe Natoli, co-authors of The User Experience Team of One (2nd edition)
2024 • Rosenfeld Community
Holly Cole
Understanding Experiences: When you have to do more than work
2018 • DesignOps Summit 2018
Gold
Matt Stone
Scaling Empathy, A Case Study in Change Management
2021 • Design at Scale 2021
Gold
Louis Rosenfeld
Discussion: What Operations can teach DesignOps
2017 • DesignOps Summit 2017
Gold
Daniel Korczynski
Why AI Is Bad at Research (and how to make it actually useful)
2026 • Advancing Research 2026
Gold
Benjamin Real
Showing the Value of DesignOps by Not Having a DesignOps Team
2020 • DesignOps Summit 2020
Gold

More Videos

Jim Kalbach

"We have never played together before and never rehearsed, yet we pulled off a great rendition spontaneously."

Jim Kalbach

Jazz Improvisation as a Model for Team Collaboration

November 6, 2017

Louis Rosenfeld

"If your topic is already tackled exceptionally by a prior book, go deeper or wait until the market shifts."

Louis Rosenfeld

Coffee with Lou: Should You Write a (UX) Book?

March 7, 2024

Catt Small

"If you’re sitting there thinking I need to build out this project and nobody else is saying the same thing, it means you have to do it, period."

Catt Small Micah Bennett Brian Carr Jessica Harllee

What's Next for ICs: Exploring Staff and Principal Designer Roles

February 22, 2024

Marieke McCloskey

"Sharing your research skills broadly within your company can create unexpected opportunities to improve experiences."

Marieke McCloskey

User Science: Product Analytics & User Research

March 11, 2021

Llewyn Paine

"User recordings are your most valuable asset but have become riskier due to biometric privacy laws."

Llewyn Paine

[Demo] Deploying AI doppelgangers to de-identify user research recordings

June 5, 2024

Joshua Noble

"Matching is very much an art, not a science; there are no hard and fast rules for what counts as a good match."

Joshua Noble

Casual Inference

October 6, 2023

Sara Logel

"We’re selectively skeptical—skeptical about some things but not others based on what we want to believe."

Sara Logel

Your Colleagues are Your Users Too

March 29, 2023

Bria Alexander

"Sponsor sessions may require registration by email to prevent Zoom bombings and protect session integrity."

Bria Alexander Louis Rosenfeld

Welcome

January 8, 2024

Sam Proulx

"If you have to learn a workaround, you want to learn it once and reuse it again and again."

Sam Proulx

Online Shopping: Designing an Accessible Experience

June 7, 2023