Rosenverse

Anatomy of a Strong User Panel

Gold
Tuesday, March 10, 2026 • Advancing Research 2026
Share the love for this talk
Anatomy of a Strong User Panel
Speakers: Sydney Lawson
Link:

Summary

User panels are one of the fastest ways to connect with your audience and extract valuable insights—when done right.

In this session, Sydney Lawson, Senior Product Marketing Manager at Rally, dives deep into real user panels—tearing them up, not down—to uncover what top research teams are doing well and what’s worth stealing for your own panel. From sign-up to participation, she’ll break down what makes panels effective and how to optimize every step of the experience.

Key Insights

  • •

    Every successful user panel has a dedicated landing page with a clear call to action and explanation of participation benefits.

  • •

    Keeping screener questions between five to ten helps maintain low friction and improves sign-up rates.

  • •

    Using single-select, closed-ended questions for job functions avoids messy and unusable data compared to open-text fields.

  • •

    Including questions about AI usage and interest helps target relevant participants for specialized research.

  • •

    Large companies like Google can afford more extensive screener forms with conditional logic due to their broad user base and resource availability.

  • •

    Separate FAQ pages linked from the landing page reduce clutter and provide potential panelists with detailed sign-up information.

  • •

    Panel engagement improves when participants see study results and understand how their feedback influences product decisions.

  • •

    Creative incentive models like digital badges (from Outsystems) can gamify participation when budgets for monetary rewards are limited.

  • •

    Including fake tools or options in screening questions (Genesys example) helps identify and filter out insincere panelists motivated only by incentives.

  • •

    Tracking participant location enables compliance with regional incentive regulations and data privacy laws.

Notable Quotes

"Every single one of these companies has a landing page on their marketing website with a call to action to sign up."

"The most successful way to ask about job function is a single-select question, not an open field."

"We love to see questions around AI and even asking if participants want to join AI studies specifically."

"Incentives are a benefit but should not be the number one reason people join a panel."

"Google’s sign-up has a progress bar which is really helpful so participants know how far they are along."

"If you ask accessibility questions, it’s so important to actually respect the answers."

"Outsystems gamified their research panel with badges because they didn’t have budget for monetary incentives."

"Genesys includes a fake tool in the software list to stop incentive-driven participants from checking all boxes."

"You want your panel to be representative of your customer base, not exactly all your customers."

"Sharing the results of studies with panelists gets them excited about contributing and keeps them engaged."

Ask the Rosenbot
Carla Casariego
DesignOps in Wonderland
2019 • DesignOps Summit 2019
Gold
Robin Beers
Research as a Catalyst for Organizational Transformation
2021 • Advancing Research 2021
Gold
Brian T. O’Neill
Does Designing and Researching Data Products Powered by ML/AI and Analytics Call for New UX Methods?
2022 • QuantQual Interest Group
Angy Peterson
More Than Technology: Personalized Public Sector Experiences
2021 • Civic Design 2021
Gold
Dr. Jamika D. Burge
Theme 3 Intro
2022 • Advancing Research 2022
Gold
Cennydd Bowles
Day 1 Panel
2024 • Designing with AI 2024
Gold
Kristin Taylor
Building Bridges Across Organizational Silos
2022 • Civic Design 2022
Gold
Dr. Nikki Smith
Research Strategy: Connecting Insights to Outcomes
2025 • Advancing Research 2025
Gold
Samuel Proulx
Invisible barriers: Why accessible service design can’t be an afterthought
2024 • Advancing Service Design 2024
Gold
Louis Rosenfeld
Day 1 Welcome
2024 • DesignOps Summit 2024
Gold
Stephen Pollard
Closing Keynote: Getting giants to dance - what can we learn from designing large and complex public infrastructure?
2017 • DesignOps Summit 2017
Gold
Johnny Michaelsen
Measure Behaviors, Not Results
2026 • Rosenfeld Community
Frances Yllana
DesignOps–Leading the Path to Parity
2023 • DesignOps Community
Laura Gatewood
Beyond Buzzwords: Adding Heart to Effective Slack Communication
2024 • DesignOps Summit 2024
Gold
Josina Vink
Navigating the pitfalls of systems thinking in service design
2024 • Advancing Service Design 2024
Gold
Ben Davies
Expert Panel: The Principles of Research Repository Design
2022 • Advancing Research 2022
Gold

More Videos

Sheri Byrne-Haber

"You want to code once and reuse components consistently for better UX; inconsistent skip-to-content links are a classic accessibility failure."

Sheri Byrne-Haber

The Importance of Accessible Design Systems

January 8, 2024

Abbey Smalley

"I had sorely underestimated how many internal tools there actually were — at least over 200."

Abbey Smalley Sylas Souza

Scaling UX Past the Size of Your Team

January 8, 2024

Jorge Arango

"You can be most successful at using new note-taking tools if you bring to the practice a different set of mental models."

Jorge Arango

Exploding the Notebook: How to Unlock the Power of Linked Notes (2nd of 3 seminars)

April 19, 2024

Sarah Williams

"We’re piloting surveys that ask customers how honest, simple, or reliable their experience was, then turn that into a score."

Sarah Williams

A Framework for CX Transformation

June 11, 2021

Yasmine Khan

"When you allow people to share their story, it's not just sharing to share; it's to contribute to better products, policies, and services."

Yasmine Khan

Checking Bias and Listening to Financially Vulnerable Americans

March 30, 2020

Dave Malouf

"I like to think about individuals as cells, teams as organs, and organizations as organisms in an ecosystem."

Dave Malouf

Theme 3: Introduction and Provocation

January 8, 2024

Jeff Gothelf

"If you don’t tell teams what to make, they need a product discovery process to decide what to build."

Jeff Gothelf

Who does what by how much?

November 20, 2025

Aleksandra Korczynska

"Simplicity can be a differentiator, as shown by Tally, which gained traction as a free, easy form builder."

Aleksandra Korczynska Caroline Jarrett Justyna Parmee

Survey Tools

March 12, 2026

Frank Duran

"When you put in that effort, you’re going to get the advocacy not only from your team but within the organization."

Frank Duran

Partnership Playbook: Lessons Learned in Effective Partnership

January 8, 2024