Rosenverse
The Heart and Brain of the AI Research

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

The Heart and Brain of the AI Research

Gold
Tuesday, March 31, 2020 • Advancing Research 2020
Share the love for this talk
The Heart and Brain of the AI Research
Speakers: Liwei Dai
Link:

Summary

As a designer research working on Conversational AI products, I’ve been collaborating with AI Researchers (Computer Scientists) and ML engineers. The cross-pollination of our two research disciplines – i.e., I bring my design thinking, storytelling, qualitative research and thick data analysis lens, while the Computer Scientists bring their logical reasoning, modeling and coding, and big data analysis lens – has resulted in a much smarter and more empathetic AI product, as well as innovations in the Cognitive AI domain. I’ll share three use cases of how we human researchers collaborate with the AI researchers and the lessons learned.

Key Insights

  • UX research often stays on the surface of usability, missing deeper impacts related to data and AI models beneath the iceberg.

  • Natural language processing models require extensive and specific training data to understand diverse user utterances.

  • AI systems struggle to identify causality, often confusing correlation with cause and effect in user queries.

  • Users often engage in investigative dialogue before reaching their true question or desired outcome.

  • Human researchers can pinpoint why users interact with AI in unexpected ways by analyzing behavior beyond simple metrics like button clicks.

  • Collaboration between human researchers and AI scientists through shared observations and joint sense-making enhances AI development.

  • AI planning, such as the monkey and banana problem, offers a framework connecting user goals with efficient AI action sequences.

  • Human-centered research can inform training data selection, helping AI models to better predict and respond to user needs.

  • Effective AI product research requires understanding the technology enough to communicate meaningfully with technical teams.

  • Human researchers increase impact by shifting from passive observers to active participants in ideation, design, and strategy discussions.

Notable Quotes

"After more than 10 years of doing UX research, I was still only working above the iceberg, focusing on the usability and feature level."

"Machines can identify correlation via association, but it’s extremely difficult for them to reason and identify causality."

"People don’t always get straight to their question; they might need to do some investigation first before they figure out what to ask."

"The AI planning monkey and banana problem made me question whether getting the bananas is really the end goal."

"By identifying the triggers that lead customers to ask questions, I helped data scientists figure out what training data to explore."

"It’s not enough just sharing customer stories and insights; we need to get into the weeds and collaborate with product and tech partners."

"We need to be genuinely curious not just about our customers, but also about our colleagues and the technology behind AI."

"Our foundational interview, observation, and sense-making skills are evergreen and indispensable in the AI world."

"To be truly impactful, human researchers need to actively participate in product design sprints and strategy meetings."

"This emerging AI technology has given us a golden opportunity to combine the heart and brain of technology and make meaningful impact."

Ask the Rosenbot
Steve Portigal
Looking Back…to Look Ahead
2024 • Advancing Research 2024
Gold
Connect with the Advancing Research Community
2026 • Advancing Research 2026
Gold
Steve Portigal
War Stories LIVE! Q&A-Discussion
2020 • Advancing Research 2020
Gold
Peter Merholz
The 2025 State of UX/Design Organizational Health
2025 • Rosenfeld Community
Peter Van Dijck
Hands-on AI #1: Let’s write your first AI eval
2025 • Rosenfeld Community
Taiye Akin-Akinyosoye
Amplifying voices and enhancing user research through group interviews
2025 • Advancing Research 2025
Gold
Kristin Skinner
Group Activity: A Deep Dive Into Value and Outcomes
2019 • DesignOps Summit 2019
Gold
Adam Cutler
Discussion
2016 • Enterprise UX 2016
Gold
Changying (Z) Zheng
Navigating Innovation with Integrity
2024 • DesignOps Summit 2024
Gold
Tamara Kartoziia
Think global, adapt local: how service design accelerated B2B market entry by 6 months
2025 • Advancing Service Design 2025
Gold
JJ Kercher
A Roadmap for Maturing Design in the Enterprise
2018 • Enterprise Experience 2018
Gold
George Aye
That Quiet Little Voice: When Design and Ethics Collide
2022 • Civic Design 2022
Gold
Harry Max
Prioritization for Leaders (2nd of 3 seminars)
2024 • Rosenfeld Community
Ariel Kennan
Civic Design in 2022
2022 • Civic Design Community
Kaitlin Tasker
Fast and Fearless Inclusive Research
2023 • Advancing Research 2023
Gold
Uday Gajendar
10 Years of Enterprise UX: Reflecting on the community and the practice
2025 • Enterprise Community

More Videos

Nathan Shedroff

"I believe that 50% of white-collar jobs are just going away in the next 5 to 10 years."

Nathan Shedroff Hugh Dubberly Thomas J. McLeish

How Will Design be Taught When the Schools Shut Down?

May 8, 2026

John Paul de Guzman

"Our mission is to raise the overall value of design in the Philippines where it’s often seen as an expense item."

John Paul de Guzman

10k Screens Later: How We Became a Data-Driven Design Organization

September 24, 2024

Aleksandra Korczynska

"Continuous feedback requires collecting responses tied to the same user across multiple channels with behavioral targeting."

Aleksandra Korczynska Caroline Jarrett Justyna Parmee

Survey Tools

March 12, 2026

Kristin Skinner

"We need to define success in ways that make our work meaningful and purposeful."

Kristin Skinner

Theme 2: Introduction and Provocation

January 8, 2024

Rachael Dietkus, LCSW

"We pay all of our speakers and provide both subject matter and professional speaker coaching to polish your presentation."

Rachael Dietkus, LCSW Victor Udoewa Jennifer Strickland

Everything You Need to Know about the Civic Design 2022 Call for Presentations

May 17, 2022

Uday Gajendar

"Enterprises are places where one hand doesn’t know what the other hand is doing and sometimes despises it."

Uday Gajendar

The Rise of Meta-Design: A Starter Playbook

May 19, 2022

Vanessa Varin

"Feedback is a lot like holding up a mirror. You're reflecting what's already working and like using a flashlight to hide in the corners."

Vanessa Varin

Feedback: The Other F-Word

September 10, 2025

Hugh Dubberly

"Designers often describe what we do as problem solving and that’s fine, but it’s tied to a 19th-century view of design as preparing things to be manufactured."

Hugh Dubberly

Problems with Problems: Reconsidering the Frame of Designing as Problem-Solving

June 19, 2019

Sean McKay

"Research wasn’t meant to be a silo. It was meant to be a guiding function, a system for creating shared knowledge that drives better decisions."

Sean McKay

Coexisting with non-researchers: Practical strategies for a democratized research future

March 11, 2025