Rosenverse
The Heart and Brain of the AI Research

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

The Heart and Brain of the AI Research

Gold
Tuesday, March 31, 2020 • Advancing Research 2020
Share the love for this talk
The Heart and Brain of the AI Research
Speakers: Liwei Dai
Link:

Summary

As a designer research working on Conversational AI products, I’ve been collaborating with AI Researchers (Computer Scientists) and ML engineers. The cross-pollination of our two research disciplines – i.e., I bring my design thinking, storytelling, qualitative research and thick data analysis lens, while the Computer Scientists bring their logical reasoning, modeling and coding, and big data analysis lens – has resulted in a much smarter and more empathetic AI product, as well as innovations in the Cognitive AI domain. I’ll share three use cases of how we human researchers collaborate with the AI researchers and the lessons learned.

Key Insights

  • UX research often stays on the surface of usability, missing deeper impacts related to data and AI models beneath the iceberg.

  • Natural language processing models require extensive and specific training data to understand diverse user utterances.

  • AI systems struggle to identify causality, often confusing correlation with cause and effect in user queries.

  • Users often engage in investigative dialogue before reaching their true question or desired outcome.

  • Human researchers can pinpoint why users interact with AI in unexpected ways by analyzing behavior beyond simple metrics like button clicks.

  • Collaboration between human researchers and AI scientists through shared observations and joint sense-making enhances AI development.

  • AI planning, such as the monkey and banana problem, offers a framework connecting user goals with efficient AI action sequences.

  • Human-centered research can inform training data selection, helping AI models to better predict and respond to user needs.

  • Effective AI product research requires understanding the technology enough to communicate meaningfully with technical teams.

  • Human researchers increase impact by shifting from passive observers to active participants in ideation, design, and strategy discussions.

Notable Quotes

"After more than 10 years of doing UX research, I was still only working above the iceberg, focusing on the usability and feature level."

"Machines can identify correlation via association, but it’s extremely difficult for them to reason and identify causality."

"People don’t always get straight to their question; they might need to do some investigation first before they figure out what to ask."

"The AI planning monkey and banana problem made me question whether getting the bananas is really the end goal."

"By identifying the triggers that lead customers to ask questions, I helped data scientists figure out what training data to explore."

"It’s not enough just sharing customer stories and insights; we need to get into the weeds and collaborate with product and tech partners."

"We need to be genuinely curious not just about our customers, but also about our colleagues and the technology behind AI."

"Our foundational interview, observation, and sense-making skills are evergreen and indispensable in the AI world."

"To be truly impactful, human researchers need to actively participate in product design sprints and strategy meetings."

"This emerging AI technology has given us a golden opportunity to combine the heart and brain of technology and make meaningful impact."

Ask the Rosenbot
Theresa Neil
Just Build Me a Dashboard!
2019 • Enterprise Community
Mark Interrante
Collaboration Flows in Product Development
2017 • Enterprise Experience 2017
Gold
Wendy Johansson
An Education on Design Education for Orgs
2021 • Design at Scale 2021
Gold
Jacqui Frey
Panel Discussion: Integrating DesignOps
2018 • DesignOps Summit 2018
Gold
Nova Wehman-Brown
We've Never Done This Before
2019 • Enterprise Experience 2019
Gold
Sean Baker
Weaving Knowledge Management into the Fabric of Our Design Practice
2025 • DesignOps Summit 2025
Gold
Chris Hodowanec
Agile + User Experience: How to navigate the Agile landscape as an UX Practitioner
2022 • Civic Design 2022
Gold
Jennifer Kong
Journeying toward AI-assisted documentation in healthcare
2024 • Designing with AI 2024
Gold
Matt Stone
Scaling Empathy, A Case Study in Change Management
2021 • Design at Scale 2021
Gold
Victor Udoewa
Theme One Intro
2023 • Advancing Research 2023
Gold
John Mortimer
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Nalini P. Kotamraju
An Organizational Story: Salesforce Lightning Design System
2016 • Enterprise UX 2016
Gold
Llewyn Paine
[Demo] Deploying AI doppelgangers to de-identify user research recordings
2024 • Designing with AI 2024
Gold
Ted Neward
Theme 4: Enterprise Organizational Journey
2019 • Enterprise Experience 2019
Gold
Jacqui Frey
Scale is Social Work
2020 • DesignOps Community
Luz Bratcher
This Is a Talk for Tired People
2022 • Design at Scale 2022
Gold

More Videos

Alexandra Schmidt

"Facilitation is the grease between the wheels of difficult organizational challenges."

Alexandra Schmidt

Enterprise UX Playbook

December 1, 2022

Jen Crim

"The team is passionate, creative, and innovative, building experiences that people love."

Jen Crim Jess Quittner Saritha Kattekola Alex Karr Gurbani Pahwa

Culture, DIBS & Recruiting

June 11, 2021

Christian Crumlish

"Use your UX skills to design better working relationships by empathizing with colleagues like you do with users."

Christian Crumlish

AMA with Christian Crumlish, author of Product Management for UX People

March 24, 2022

Libby Maurer

"If diversity is being asked to the party, inclusion is being asked to dance, and belonging is actually dancing with everyone else."

Libby Maurer

Treating Diversity & Inclusion in Hiring as a Design Problem

December 5, 2019

Ali Jeffery

"Technology is a tool, not a solution in itself; it needs human input."

Ali Jeffery Sheri Chudow

How DesignOps Helped Enable Wall Street to Work Remotely

October 22, 2020

Daniel Gloyd

"Design research often acts like scientists with clipboards rather than humans in conversation."

Daniel Gloyd

Designing From the Inside Out: How Method Acting Can Inspire Design Research

February 12, 2026

Kristin Skinner

"The future of education lies in collaboration and adaptation."

Kristin Skinner

Five Years of DesignOps

September 29, 2021

Johanna Kollmann

"The most significant source of confusion is the difference between research questions and interview questions - Erica Hall."

Johanna Kollmann

Insights-Driven Product Strategy: Get your Research to Count

December 6, 2022

David Sternberg

"The interface you’ve designed is like a landscape shaping the flow of user behavior as water flows through a stream."

David Sternberg

Uncovering the hidden forces shaping user behavior

July 17, 2025