Anatomy of a Strong User Panel
Summary
User panels are one of the fastest ways to connect with your audience and extract valuable insights—when done right. In this session, Sydney Lawson, Senior Product Marketing Manager at Rally, dives deep into real user panels—tearing them up, not down—to uncover what top research teams are doing well and what’s worth stealing for your own panel. From sign-up to participation, she’ll break down what makes panels effective and how to optimize every step of the experience.
Key Insights
-
•
Every successful user panel has a dedicated landing page with a clear call to action and explanation of participation benefits.
-
•
Keeping screener questions between five to ten helps maintain low friction and improves sign-up rates.
-
•
Using single-select, closed-ended questions for job functions avoids messy and unusable data compared to open-text fields.
-
•
Including questions about AI usage and interest helps target relevant participants for specialized research.
-
•
Large companies like Google can afford more extensive screener forms with conditional logic due to their broad user base and resource availability.
-
•
Separate FAQ pages linked from the landing page reduce clutter and provide potential panelists with detailed sign-up information.
-
•
Panel engagement improves when participants see study results and understand how their feedback influences product decisions.
-
•
Creative incentive models like digital badges (from Outsystems) can gamify participation when budgets for monetary rewards are limited.
-
•
Including fake tools or options in screening questions (Genesys example) helps identify and filter out insincere panelists motivated only by incentives.
-
•
Tracking participant location enables compliance with regional incentive regulations and data privacy laws.
Notable Quotes
"Every single one of these companies has a landing page on their marketing website with a call to action to sign up."
"The most successful way to ask about job function is a single-select question, not an open field."
"We love to see questions around AI and even asking if participants want to join AI studies specifically."
"Incentives are a benefit but should not be the number one reason people join a panel."
"Google’s sign-up has a progress bar which is really helpful so participants know how far they are along."
"If you ask accessibility questions, it’s so important to actually respect the answers."
"Outsystems gamified their research panel with badges because they didn’t have budget for monetary incentives."
"Genesys includes a fake tool in the software list to stop incentive-driven participants from checking all boxes."
"You want your panel to be representative of your customer base, not exactly all your customers."
"Sharing the results of studies with panelists gets them excited about contributing and keeps them engaged."
Or choose a question:
More Videos
"Aligning on a north star problem gets everyone excited and aligned from the beginning."
Jon Fukuda Amy Evans Ignacio Martinez Joe MeersmanThe Big Question about Innovation: A Panel Discussion
September 25, 2024
"The best way is to distribute the accessibility work so it becomes light work for everyone."
Sam ProulxAccessibility: An Opportunity to Innovate
March 9, 2022
"Diversity is not just about how people look or sound, but also about their capabilities and their place on introversion-extraversion scales."
Anna Avrekh Amy Jiménez Márquez Morgan C. Ramsey Catarina TsangDiversity In and For Design: Building Conscious Diversity in Design and Research
June 9, 2021
"Context retention is tough; Siri and Google Assistant completely lose prior contexts after one action."
Greg NudelmanDesigning Conversational Interfaces
November 14, 2019
"We translate absolute positioning from design tools into web-based layouts using row and flex concepts familiar to developers."
George Abraham Stefan IvanovDesign Systems To-Go: Reimagining Developer Handoff, and Introducing App Builder (Part 2)
October 1, 2021
"Workshops are not just about input, but about diverging and converging to make decisions together."
Shipra KayanMake your research synthesis speedy and more collaborative using a canvas
January 24, 2025
"It is very difficult for somebody who has never used assistive technology to have the same experience as someone who uses it daily for everything."
Sam ProulxDesigning For Screen Readers: Understanding the Mental Models and Techniques of Real Users
December 10, 2021
"I tried to do everything all by myself at first and it didn’t catch on because no one else knew I was doing it."
Shipra KayanHow we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
September 30, 2021
"Gestures serve as a window into the embodied mind by replaying prior embodied experiences when we communicate."
Dane DeSutterKeeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
March 26, 2024
