Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Improving Democratized Research with CustomGPTs and Gems

Wednesday, February 25, 2026 • Rosenfeld Community
Share the love for this talk
Improving Democratized Research with CustomGPTs and Gems
Speakers: Mike Oren
Link:

Summary

One of the biggest concerns researchers have when having any designer or product manager conduct their own research is that they'll ask biased or bad questions. In theory bad research done by a product team should be accountable to them but since there's a team named "research," that can inevitably fallback on us. We've all offered training to teams at some point but you can lead a horse to water but not force them to drink. Enter AI - your partners will want to use it because it helps them get something they don't usually do (write discussion guides) faster and by writing custom Gems or GPTs, the research team can keep consistency, ensure the AI pushes back in the right way for quality, etc. In this session, I'll cover how to build these and the instruction sets I provide to the tools.

Key Insights

  • Custom AI GPTs can provide guardrails to help non-researchers conduct higher-quality user research.

  • Splitting AI tools into multiple specialized GPTs prevents context overload and hallucinations.

  • Researchers save over 80% of their time by using AI to support routine research planning and execution.

  • Automating recruitment and incentive tracking through Google Sheets and Zapier reduces manual effort.

  • AI can improve research consistency by enforcing unbiased question guidelines and avoiding leading or double-barreled questions.

  • Limitations remain in AI’s ability to synthesize large transcript sets and provide fully accurate quotes.

  • Democratizing research allows product managers and designers to engage more closely with customers while researchers focus on strategic insights.

  • Avoiding shadow AI tools is critical for organizational security and compliance.

  • Video analysis and unmoderated usability testing can now be partially automated using custom GPT Gems.

  • The future of UX research may shift toward researchers providing ‘forest-level’ insights while PMs/designers handle ‘tree-level’ tactical research.

Notable Quotes

"We call ourselves a B2C CRM: helping businesses connect to their consumers and keep the relationship going."

"Before AI, research teams spent over a quarter of their time consulting about research questions, often repeating themselves."

"One of my biggest pet peeves is biased questions; I hate the term validation, I prefer evaluation."

"If we’re not helping with the decision, why are they paying us what they’re paying us? That’s the essence of research."

"We want to make sure researchers spend one hour in office hours, not eight to twelve hours a week helping others."

"Designers and product managers often want more control, and custom AI gives them that in research tasks."

"The tools are meeting people where they’re already going: ChatGPT or Gemini, rather than forcing new platforms."

"Shadow AI usage is a huge security risk in public companies and should be managed by IT and leadership."

"We ask our AI assistants to explicitly avoid leading and double-barreled questions to ensure unbiased research."

"The future is researchers painting the larger picture while PMs and designers focus on deep, tactical user insights."

Ask the Rosenbot
Luca Rager
Empowering Gaming at Scale: How Xbox Builds Powerful, Automated, and Distributed Design Systems with Sketch
2021 • DesignOps Summit 2021
Gold
Rachael Dietkus, LCSW
Leading through the long tail of trauma
2022 • Advancing Research Community
Steve Krug
Don’t Make Me Think 3.0: What Endures and What Evolves in UX
2026 • Advancing Research 2026
Gold
Joe Meersman
Use AI to Drive Outcomes that Go Beyond the Design Sprint
2024 • DesignOps Summit 2024
Gold
David Cronin
The GE Design System and Thoughts about Craft at Scale
2015 • Enterprise UX 2015
Gold
Alla Weinberg
Workers Are Sick of Change: The Cure is Psychological Safety
2023 • Enterprise UX 2023
Gold
Ash Brown
Silver Linings: What DesignOps Learned in the Shift to WFH
2020 • DesignOps Summit 2020
Gold
Smitha Papolu
Theme 3 Discussion
2024 • Enterprise Experience 2020
Gold
Sohit Karol
Designing Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning
2020 • Advancing Research 2020
Gold
Nidhi Singh Rathore
Embracing participation to unlock deeper truths in commercial research
2025 • Advancing Research 2025
Gold
Lija Hogan
Contexts of Use: A Framework for Connection
2021 • Civic Design 2021
Gold
Nicole Aleong
Future Orientations to Everyday Life: Futures Anthropology as a Methodology
2024 • Advancing Research 2024
Gold
Andy Warr
Under My (Research) Umbrella: The Benefits and Challenges of Building a Unified Insights Function
2024 • Advancing Research 2024
Gold
Sol Mesz
Hands or Brains? How to Hire for Strategy, Strategically
2024 • Enterprise Experience 2020
Gold
John Mortimer
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Dan Willis
Enterprise Storytelling Sessions
2015 • Enterprise UX 2015
Gold

More Videos

Greg Petroff

"We have to be advocates for growth mindset and process improvement because people fall back on old ways even in times of change."

Greg Petroff

Software as Material—A Redux

June 6, 2023

Brendan Jarvis

"We don’t have to restrict ourselves to playing the canary in the coal mine. We can design the harm out of our products before they’ve even taken flight."

Brendan Jarvis

Framing Tomorrow by Questioning Today

June 8, 2022

Prerna Makanawala

"Put all product screenshots together to clearly show that different products look different and must feel like one company."

Prerna Makanawala

Achieving Balanced Design Consistency

June 9, 2021

Tricia Wang

"We are stuck in the user trap because these platforms are central to being human today."

Tricia Wang

From Users to Shapers of AI: The Future of Research

March 25, 2024

Cheryl Platz

"Competitiveness doesn’t motivate play as much as it used to; companionship and collaboration are more motivating now."

Cheryl Platz

Embrace Your Fun Factor: Game Development Best Practices for Product Design

January 9, 2026

Ariel Kennan

"There’s inherent conflict that will arise when navigating many stakeholders."

Ariel Kennan

Theme Two Intro

November 17, 2022

Tricia Wang

"It's not about going out to communities but changing your team and leadership to genuinely reflect those communities."

Tricia Wang

The most popular design thinking strategy is BS

January 27, 2022

Kristin Wisnewski

"Before, we never really looked holistically at decades of UX data—now we use it to be proactive and avoid duplicative studies."

Kristin Wisnewski

Measuring What Matters

October 23, 2019

Scott Jensen

"Both of our perspectives changed, and now we’re seeing that come to fruition through the product we’re building."

Scott Jensen Sarah Delaney Carmen Liu

Short Take #2: UX/Product Lessons from Your Industry Peers

December 6, 2022