Rosenverse
How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]

Thursday, August 31, 2023 • Advancing Research Community
Share the love for this talk
How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]
Speakers: Dr. Jamika D. Burge , Nick Fine , Alexandra Jayeun Lee , Greg Nudelman and Bo Wang
Link:

Summary

Four of your research colleagues discussed and defended their respective positions (below) on the impact of AI on user research. Participants engaged in a discussion and Q&A, facilitated by Dr. Jamika D. Burge. “AI has the potential to be the researcher's best friend, by doing all the heavy lifting associated with analysis - but it also has the potential to cause unimaginable damage”.

– Nick Fine

“Researchers absolutely must learn to create AI prompts. Not only will prompt engineering become an essential, required research skill, but it will also offer a much-needed opportunity to rethink our role as facilitators of change.”

– Alexandra Jayeun Lee

Soon, AI will be able to utilize the participant's feedback as a prompt to create RITE design variations on the fly, offering the researcher multiple flow options organically and in real time, which will radically transform our research practice.”

– Greg Nudelman

“UX Researchers can reinvent themselves as “delightful ethicists” who oversee ethics on critical issues when generative AI supplies abundant solutions without providing the why."

– Bo Wang

Key Insights

  • •

    AI poses both great risks and opportunities for UX research, with validity and bias being central concerns.

  • •

    Inexperienced researchers relying on AI outputs without critical judgment risk spreading inaccurate insights.

  • •

    Prompt engineering is emerging as a fundamental skill for UX researchers, similar to how coding became essential for designers.

  • •

    AI can automate repetitive design tasks and rapid prototyping, enabling faster iteration and freeing researchers for higher-level strategy.

  • •

    Moderated usability testing will not be fully replaced by AI due to the irreplaceable nature of human empathy and adaptive interaction.

  • •

    UX researchers should evolve into 'delightful ethicists' leading ethical AI practices and guarding against 'dark AI' and synthetic users.

  • •

    Ethics in AI extends beyond moral principles to everyday product decisions and protecting users from harm.

  • •

    Bias is inherent in AI training data and tools; researchers must call out, understand, and address such bias explicitly.

  • •

    Demonstrating tangible business value by linking user research to outcomes remains essential for maintaining researcher relevance.

  • •

    Collective learning across disciplines and broadening AI literacy within the research community is critical to navigate AI’s impact.

Notable Quotes

"AI has as much capacity to do as much harm as it does good."

"It takes an experienced researcher to be able to wrangle AI prompts to have any chance of getting good work."

"Learning prompt engineering will make us better researchers in the same way coding helped designers."

"The best large language model is right under your nose: the human brain with 300,000 years of ancestral development."

"AI gives us superpowers to do rapid iterative testing and evaluation much faster than before."

"We should reinvent UX researchers to be delightful ethicists leading ethical concerns in AI adoption."

"AI cannot do empathy; moderated usability testing requires the human ability to pivot and connect."

"AI is biased by design; assume bias is in there, call it out, and then address it."

"User research's value lies in linking user needs and pain points directly to business profit and loss."

"If we don’t advocate for understanding AI, more decisions will be made without researchers, leading to unjust outcomes."

Ask the Rosenbot
Marissa Cui
Climate Design Product Showcase
2024 • Climate UX Interest Group
Bria Alexander
State of DesignOps Panel
2021 • DesignOps Summit 2021
Gold
Sean Baker
Weaving Knowledge Management into the Fabric of Our Design Practice
2025 • DesignOps Summit 2025
Gold
Bria Alexander
Opening Remarks Day 1
2024 • Advancing Research 2024
Gold
Toby Haug
Discussion
2017 • Enterprise Experience 2017
Gold
Sharon Bautista
Time to Make the Donuts: How User Research Helped Bridge Disparate Teams
2024 • Enterprise Experience 2020
Gold
Bria Alexander
Reflect and Chart Forward
2021 • Civic Design 2021
Gold
Kavana Ramesh
Meaningful inclusion: Practicing accessibility research with confidence
2024 • DesignOps Summit 2024
Gold
Sarah Auslander
Insights Panel
2022 • Civic Design 2022
Gold
Chris Geison
What's Next for Research?
2021 • Advancing Research Community
Sean Fitzell
Craft of User Research: Building Out Jobs to be Done Maps
2021 • Advancing Research 2021
Gold
Dave Malouf
The Future of DesignOps
2024 • DesignOps Summit 2020
Gold
Ovetta Sampson
Research in the Automated Future
2022 • Advancing Research 2022
Gold
Sarah Sgarlato Pierini
From Passion to Execution: A Story of Evolving Research Maturity at LinkedIn
2022 • DesignOps Summit 2022
Gold
Barb Spanton
Doing Work That Matters: A Look Beyond The Idealistic Notion of 'Doing Meaningful Work'
2022 • Design at Scale 2022
Gold
Vincent Brathwaite
Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams
2020 • DesignOps Summit 2020
Gold

More Videos

Corey Long

"Respect candidates’ time and attention; don’t multitask during interviews no matter how busy you are."

Corey Long

Hiring in DesignOps: A Critical Study on How to Hire and Get Hired

September 23, 2024

Gretchen Anderson

"Designers can be really paranoid and very precious."

Gretchen Anderson

Scaling the Human Center

June 8, 2017

Lori Muszynski

"No designer should ever work alone in part for this reason. You need to team apply your design."

Lori Muszynski Peter Merholz

Keeping Design Weird

October 2, 2023

Sam Proulx

"Screen readers let us jump directly to content, replicating visual skimming of a web page."

Sam Proulx

SUS: A System Unusable for Twenty Percent of the Population

June 9, 2021

Prayag Narula

"Companies have started building their own base camps, but these feel more exclusionary compared to grassroots ones."

Prayag Narula Rida Qadri

HCI 2.0: Humanity Deserves the Attention that UX Research has to Offer

March 28, 2023

Deanna Smith

"Processes are never perfect, but thoughtful testing limits disruption for your team."

Deanna Smith

Leading Change with Confidence: Strategies for Optimizing Your Process

September 23, 2024

Lija Hogan

"Democratization helps free up researchers by shifting ad hoc research to others."

Lija Hogan

Doing more with more: Lessons from the Front Lines of Democratization

March 9, 2022

Sam Proulx

"We are beginning to see cycles of history repeat themselves in accessibility, especially in gaming and AR/VR."

Sam Proulx

To Boldly Go: The New Frontiers of Accessibility

March 11, 2022

Bria Alexander

"Sponsor sessions do not overlap at all with the main programming. It is 100% fully optional."

Bria Alexander

Opening Remarks

October 3, 2023