Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Harnessing AI in UXR: Practical Strategies for Positive Impact

Gold
Tuesday, March 26, 2024 • Advancing Research 2024
Share the love for this talk
Harnessing AI in UXR: Practical Strategies for Positive Impact
Speakers: Savina Hawkins
Link:

Summary

Join Savina Hawkins as she presents a focused exploration of large language models in User Experience Research (UXR). This talk zeroes in on practical, actionable strategies for leveraging these advanced AI tools to enhance UXR outcomes. Savina will discuss the dual nature of large language models, illuminating their potential to both revolutionize and challenge UXR practices. Attendees will learn to identify and mitigate risks while maximizing the benefits of these models in real-world scenarios. The session promises a clear, concise roadmap for UX researchers to effectively integrate large language models into their workflow, ensuring positive, impactful results.

Key Insights

  • Judd Anton predicts prompt engineering will be a foundational skill for researchers by 2025.

  • AI tools have enabled condensing thousands of user insights into manageable unique ideas within minutes.

  • Large language models learn language skills purely from statistical patterns, not human understanding.

  • GPT’s transformer architecture allows fast and contextually relevant text generation.

  • Prompt engineering is both a science of optimization and an art of design mirroring qualitative interview skills.

  • Prompt chaining can sequentially automate complex, multi-step analysis workflows.

  • AI-generated outputs are probabilistic and sometimes incorrect, requiring critical human oversight.

  • Multi-threaded prompt chaining workflows can achieve human-quality qualitative analysis at scale.

  • The rise of AI in knowledge work challenges existing power structures, workflows, and capitalism itself.

  • Researchers’ humanistic skills uniquely position them to co-design ethical AI systems and maintain meaning-making.

Notable Quotes

"The best researchers are multi-method and they have five tools, with prompt engineering as the fifth emerging one."

"In just 15 minutes, I extracted thousands of quotes and turned feedback into a strategic opportunity map in 30 minutes."

"GPT is like a master chef who’s traveled the world sampling cuisines before creating new dishes."

"Large language models don’t understand language like we do; they generate statistically likely text based on training data."

"Prompt engineering is the craft of using specific inputs to elicit precise AI outputs, similar to designing discussion guides."

"Chains of prompts become designed information processing workflows that can scale research tasks."

"These AI tools can do the entire qualitative analysis process at the click of a button."

"Magic eight ball thinking is the risk of blindly accepting AI answers without critical evaluation."

"Artificial intelligence can’t produce meaning the way humans do; it industrializes plausible content generation."

"Our challenge is to design how humans and technology share the world in peace while shaping new knowledge work."

Ask the Rosenbot
Sara Logel
Your Colleagues are Your Users Too
2023 • Advancing Research 2023
Gold
Jorge Arango
AI as Thought Partner: How to Use LLMs to Transform Your Notes (3rd of 3 seminars)
2024 • Rosenfeld Community
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Civic Design 2022
Gold
Joerg Beringer
Scaling User Research with AI: Continuous Discovery of User Needs in Minutes
2025 • DesignOps Summit 2025
Gold
James Chudley
Decarbonising User Journeys: How minimising enables us to do more with less
2025 • Climate UX Interest Group
Katie Johnson
Disrupting generative AI products with just-in-time consumer insights
2024 • Designing with AI 2024
Gold
Chris Hodowanec
Agile + User Experience: How to navigate the Agile landscape as an UX Practitioner
2022 • Civic Design 2022
Gold
Etienne Fang
Power of Insights: Why sharing is better than silos with Uber’s Insights Platform
2019 • Advancing Research Community
Zen Ren
Taking Inspiration from Instructional Design for Research
2022 • Advancing Research 2022
Gold
John Calhoun
Two Sides of the DesignOps Coin: Teams Ops and Product Ops
2024 • DesignOps Summit 2020
Gold
Ned Dwyer
The Intersection of Design and ResearchOps
2024 • DesignOps Summit 2024
Gold
Marisa Bernstein
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
2021 • Civic Design 2021
Gold
Daniel Gloyd
Warming the User Experience: Lessons from America's first and most radical human-centered designers
2024 • Rosenfeld Community
Nathan Curtis
Discussion
2016 • Enterprise UX 2016
Gold
Alexandra Schmidt
Enterprise UX Playbook
2022 • Enterprise Community
Louis Rosenfeld
Coffee with Lou #3: What Makes for a Successful UX Conference Presentation?
2024 • Rosenfeld Community

More Videos

Sheri Byrne-Haber

"Accessibility defects are bugs. If it’s a P1 blocking bug for an accessibility issue, treat it like any other P1 bug."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Prayag Narula

"Integrating psychology into product strategy isn't optional; it's essential for success."

Prayag Narula Hannah Hudson

Empowering Designers to do Good Research

March 11, 2022

Janelle Estes

"Inclusive research means building for diverse people, not just for ourselves or a narrow segment."

Janelle Estes

UX Research Trends

January 28, 2021

Craig Brookes

"Collaboration without ego is key to building the right product, not just what one's own interests are."

Craig Brookes Andreas Huebner Morgan Quinn

"Just Make it Look Good" and Other Ways We're Misunderstood

June 11, 2021

Marc Fonteijn

"If you don’t feel connected and you’re standing alone, the challenge looks much bigger."

Marc Fonteijn Ru Butler

Increase your confidence, influence, and impact (through a Professional Community)

December 3, 2024

Kate Towsey

"Research ops provides the roles, tools, and processes needed to support researchers — that’s as concise as it gets."

Kate Towsey

The State of ResearchOps: More Than Just Theory

June 20, 2019

Alla Weinberg

"Our nervous system is ancient; it can’t tell the difference between an angry email and a tiger lurking."

Alla Weinberg

Design Teams Need Psychological Safety: Here’s How to Create It

September 9, 2022

Shawna Hein

"We treat our shared tooling and design system as a product with a dedicated team maintaining reusable components and governance."

Shawna Hein Kevin Hoffman

Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts

November 17, 2022

Tricia Wang

"Systematizing work and using matrices of importance versus difficulty helps prioritize meaningful projects."

Tricia Wang

SCALE: Discussion

June 15, 2018