Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Global Research Panels

Saturday, August 8, 2020 • DesignOps Community
Share the love for this talk
Global Research Panels
Speakers: Wyatt Hayman
Link:

Summary

In this talk, Wyatt conducts a deep dive into the Airbnb Global Research Panels, the program he has been developing at Airbnb over the past two years. Launch: why Airbnb created the Global Research Panels, the key decisions and the internal alignment required for launching the first version of the Global Research Panel Process: detailed look into the current version of the Global Research Panels, including the mechanics and tools used to manage it Impact: demonstration of ways the Global Research Panels have provided value over the past two years at Airbnb Evolution: see how the Global Research Panels has grown through six iterations so far and the vision for the Global Research Panels program going forward

Key Insights

  • Airbnb’s research panels focus on qualitative, not statistically significant, feedback from global users across 60 countries in 11 languages.

  • The panels were created to solve the gap of quick access to non-English speakers for product research, as most researchers operate primarily in English.

  • Early pilot panels included a mostly English-speaking group in Sydney and a non-English pilot in Tokyo.

  • Participants commit to six months with a reward equivalent to $400 US purchasing power, adjusted per country, paid in two parts and contingent on participation.

  • Qualtrics’ Target Audience product was chosen for panel management due to existing relationships and capabilities.

  • Human translation for surveys and responses is preferred to maintain quality, though machine translation is used occasionally for urgency.

  • Panels evolved from complex mechanisms with prototypes and online discussions to simpler survey and remote interview formats to improve operational efficiency.

  • Smaller panel sizes (~90 per market) allow for qualitative insights, focusing on proportional representation aligned to Airbnb’s user base in each market.

  • Non-research teams at Airbnb have started using the panels for quick feedback without needing to recruit or handle NDAs themselves.

  • Future ambitions include expanding live multilingual interviews and integrating more diversity and accessibility data into participant profiles.

Notable Quotes

"Our research operations team’s mission is to let researchers focus on research without worrying about operational details."

"Half of Airbnb’s traffic is from non-English devices and 80% of bookings involve at least one party outside the U.S."

"We ended up piloting a group in Tokyo for non-English speakers, which was key to testing the language challenge."

"Participants are paid based on purchasing power parity — $400 USD equivalent spread over six months for active participation."

"We decided to limit panel access initially to the research team but are exploring expanding to other teams."

"We run a two-week cycle now because translations back and forth require more time for quality."

"The panels are primarily qualitative tools and not meant for statistically significant quantitative research."

"We send out surveys weekly, but respondents have two weeks to answer, accommodating different time zones and bandwidth."

"The panels help researchers test assumptions, check cultural sensitivities, and quickly iterate globally."

"Non-research teams can use the panels easily — one program manager arranged interviews with hosts in 6 countries within a week."

Ask the Rosenbot
Tamara Kartoziia
Think global, adapt local: how service design accelerated B2B market entry by 6 months
2025 • Advancing Service Design 2025
Gold
Yoel Sumitro
Actions and Reflections: Bridging the Skills Gap among Researchers
2022 • Advancing Research 2022
Gold
Nova Wehman-Brown
We've Never Done This Before
2019 • Enterprise Experience 2019
Gold
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • Advancing Research 2022
Gold
JP Allen
Navigating the UX Tools Landscape
2021 • DesignOps Summit 2021
Gold
Peter Merholz
Customer-Centered Design Organizations
2017 • Enterprise Experience 2017
Gold
Sam Proulx
Designing For Screen Readers: Understanding the Mental Models and Techniques of Real Users
2021 • Civic Design 2021
Gold
Savina Hawkins
Harnessing AI in UXR: Practical Strategies for Positive Impact
2024 • Advancing Research 2024
Gold
Connect with the Advancing Research Community
2026 • Advancing Research 2026
Conference
Holly Cole
Panel Discussion: Growing People and Teams
2018 • DesignOps Summit 2018
Gold
Michele Marut
Research Repositories Reconsidered
2019 • DesignOps Community
Steve Portigal
Discussion
2015 • Enterprise UX 2015
Gold
Matt Duignan
Atomizing Research: Trend or Trap
2020 • Advancing Research 2020
Gold
Mike Oren
Why Pharmaceutical's Research Model Should Replace Design Thinking
2023 • Advancing Research 2023
Gold
Sheri Byrne-Haber
The Importance of Accessible Design Systems
2024 • DesignOps Summit 2020
Gold
Shreya Dhawan
Making service tangible: the fastest path to higher performance
2025 • Advancing Service Design 2025
Gold

More Videos

Daniel Gloyd

"Meisner taught actors to respond truthfully in the moment, prioritizing presence over preconceived ideas."

Daniel Gloyd

Designing From the Inside Out: How Method Acting Can Inspire Design Research

February 12, 2026

Deirdre Hirschtritt

"We fight fiercely for clients, but we’re honest about government limits and project scope to build trust."

Deirdre Hirschtritt Cesar Paredes Marie Perrot

Research is Only as Good as the Relationships You Build

November 17, 2022

Benjamin Real

"It was like giving a map that you could not read or even understand."

Benjamin Real

Maturity Models: A Core Tool for Creating a DesignOps Strategy

October 1, 2021

Max Gadney

"What is your theory of change? How are you actually going to achieve the outcome you’re aiming for?"

Max Gadney Andrea Petrucci Joshua Stehr Hannah Wickes

Assessing UX jobs for impact in climate

August 14, 2024

Lada Gorlenko

"From fast-paced tech worlds, you will appreciate the patience and perseverance it takes to move an old champion."

Lada Gorlenko

Theme 1: Intro

January 8, 2024

Feyikemi Akinwolemiwa

"C-FRE stands for curiosity, freedom, reframing, exploration, and engagement—the soft qualities we tend to overlook in play."

Feyikemi Akinwolemiwa

Play to innovate: How curiosity and experimentation transform UX

March 11, 2026

Bria Alexander

"If you have a question at the end of a presentation, please put that question in the thread associated with the talk."

Bria Alexander

Opening Remarks

March 29, 2023

Llewyn Paine

"Replacing the entire body with an avatar future-proofs against unanticipated identifiers like tattoos or moles."

Llewyn Paine

[Demo] Deploying AI doppelgangers to de-identify user research recordings

June 5, 2024

Bria Alexander

"When teams are connected to real strategic missions and own their key results, OKRs become positive."

Bria Alexander Benson Low Natalya Pemberton Stephanie Goldthorpe

OKRs—Helpful or Harmful?

January 20, 2022