Rosenverse
Improving Democratized Research with CustomGPTs and Gems

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Improving Democratized Research with CustomGPTs and Gems

Wednesday, February 25, 2026 • Rosenfeld Community
Share the love for this talk
Improving Democratized Research with CustomGPTs and Gems
Speakers: Mike Oren
Link:

Summary

One of the biggest concerns researchers have when having any designer or product manager conduct their own research is that they'll ask biased or bad questions. In theory bad research done by a product team should be accountable to them but since there's a team named "research," that can inevitably fallback on us. We've all offered training to teams at some point but you can lead a horse to water but not force them to drink. Enter AI - your partners will want to use it because it helps them get something they don't usually do (write discussion guides) faster and by writing custom Gems or GPTs, the research team can keep consistency, ensure the AI pushes back in the right way for quality, etc.
In this session, I'll cover how to build these and the instruction sets I provide to the tools.

Key Insights

  • •

    Custom AI GPTs can provide guardrails to help non-researchers conduct higher-quality user research.

  • •

    Splitting AI tools into multiple specialized GPTs prevents context overload and hallucinations.

  • •

    Researchers save over 80% of their time by using AI to support routine research planning and execution.

  • •

    Automating recruitment and incentive tracking through Google Sheets and Zapier reduces manual effort.

  • •

    AI can improve research consistency by enforcing unbiased question guidelines and avoiding leading or double-barreled questions.

  • •

    Limitations remain in AI’s ability to synthesize large transcript sets and provide fully accurate quotes.

  • •

    Democratizing research allows product managers and designers to engage more closely with customers while researchers focus on strategic insights.

  • •

    Avoiding shadow AI tools is critical for organizational security and compliance.

  • •

    Video analysis and unmoderated usability testing can now be partially automated using custom GPT Gems.

  • •

    The future of UX research may shift toward researchers providing ‘forest-level’ insights while PMs/designers handle ‘tree-level’ tactical research.

Notable Quotes

"We call ourselves a B2C CRM: helping businesses connect to their consumers and keep the relationship going."

"Before AI, research teams spent over a quarter of their time consulting about research questions, often repeating themselves."

"One of my biggest pet peeves is biased questions; I hate the term validation, I prefer evaluation."

"If we’re not helping with the decision, why are they paying us what they’re paying us? That’s the essence of research."

"We want to make sure researchers spend one hour in office hours, not eight to twelve hours a week helping others."

"Designers and product managers often want more control, and custom AI gives them that in research tasks."

"The tools are meeting people where they’re already going: ChatGPT or Gemini, rather than forcing new platforms."

"Shadow AI usage is a huge security risk in public companies and should be managed by IT and leadership."

"We ask our AI assistants to explicitly avoid leading and double-barreled questions to ensure unbiased research."

"The future is researchers painting the larger picture while PMs and designers focus on deep, tactical user insights."

Ask the Rosenbot
Bilan Hashi
The Tension Between Story Collecting and Story Telling in Research
2021 • Advancing Research 2021
Gold
Meghan Bausone
Systems Thinking and Design Innovation: Working with Leverage Points in Rural Maternal Health Systems
2026 • Rosenfeld Community
Jemma Ahmed
Theme 2 Intro
2022 • Advancing Research 2022
Gold
Hana Nagel
Turning Research Ripples into Waves
2018 • DesignOps Summit 2018
Gold
Sam Ladner
How Research Can Drive Strategic Foresight
2022 • Advancing Research 2022
Gold
Tricia Wang
SCALE: Discussion
2018 • Enterprise Experience 2018
Gold
Mark Interrante
AI for Prioritization (3rd of 3 seminars)
2024 • Rosenfeld Community
Alla Weinberg
Healing Toxic Stress
2024 • DesignOps Summit 2024
Gold
Greg Nudelman
Designing Conversational Interfaces
2019 • Enterprise Community
Richard Buchanan
Creativity and Principles in the Flourishing Enterprise
2018 • Enterprise Experience 2018
Gold
Benjamin Real
Showing the Value of DesignOps by Not Having a DesignOps Team
2020 • DesignOps Summit 2020
Gold
Ryan Rumsey
Business Influence Without Losing Your Soul
2021 • Enterprise Community
Caitlyn Hampton
Compass 101: Growing Your Career In A Startup World
2021 • Design at Scale 2021
Gold
Kate Kalcevich
Designing inclusively with AI
2024 • Designing with AI 2024
Gold
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • DesignOps Summit 2022
Gold
Adel Du Toit
Get Your CFO To Say: 'Our Strategic Goal is User Obsession'
2022 • Design at Scale 2022
Gold

More Videos

Corey Long

"Being humble enough to ask a competitor for feedback changed everything and led directly to job offers."

Corey Long

Hiring in DesignOps: A Critical Study on How to Hire and Get Hired

September 23, 2024

Gretchen Anderson

"Prototyping is not about usability, it’s about exploring the idea."

Gretchen Anderson

Scaling the Human Center

June 8, 2017

Lori Muszynski

"Your work is not your identity. You are gonna hear no, and that’s okay."

Lori Muszynski Peter Merholz

Keeping Design Weird

October 2, 2023

Sam Proulx

"Remote testing helps get closer to real-world results because users are in environments customized for them."

Sam Proulx

SUS: A System Unusable for Twenty Percent of the Population

June 9, 2021

Prayag Narula

"We shouldn't let the world of computer science make us forget our own power and what we bring to the table."

Prayag Narula Rida Qadri

HCI 2.0: Humanity Deserves the Attention that UX Research has to Offer

March 28, 2023

Deanna Smith

"Using pilots can get buy-in from stakeholders who might resist broad change initially."

Deanna Smith

Leading Change with Confidence: Strategies for Optimizing Your Process

September 23, 2024

Lija Hogan

"Democratization helps free up researchers by shifting ad hoc research to others."

Lija Hogan

Doing more with more: Lessons from the Front Lines of Democratization

March 9, 2022

Sam Proulx

"There isn’t a time I can remember where there wasn’t a computer talking to me."

Sam Proulx

To Boldly Go: The New Frontiers of Accessibility

March 11, 2022

Bria Alexander

"If you have any questions for the speakers, you really need to put your question in the thread specific to the talk."

Bria Alexander

Opening Remarks

October 3, 2023