Rosenverse
Data-Prompted Interviews

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Data-Prompted Interviews

Friday, December 17, 2021 • QuantQual Interest Group
Share the love for this talk
Data-Prompted Interviews
Speakers: Amelia Cole
Link:

Summary

In this session, Amelia unpacks data-prompted interviews with an emphasis on Experience Sampling Methods. You will learn the essentials of running an Experience Sampling study and how to use quantitative data during interviews to enhance our understanding of daily life activities and experiences.

Key Insights

  • •

    Data prompted interviews use participants’ own quantitative data to guide qualitative exploration, enhancing insight depth.

  • •

    Experience Sampling Methods capture real-time, repeated snapshots of participants’ thoughts and actions to track temporal patterns.

  • •

    Balancing sampling frequency, survey length, and study duration is critical to avoid participant fatigue in longitudinal ESM studies.

  • •

    Four trigger types in ESM—random, fixed, contextual, and self-initiated—serve distinct research purposes.

  • •

    High attrition and resource intensity are common challenges in ESM, necessitating careful preparation and participant engagement.

  • •

    Reactivity, where participants alter behavior due to observation, is an inherent feature of ESM and can enhance participant metacognition.

  • •

    Unstructured interviews following ESM offer participant-controlled, rich narratives that reveal the why behind quantitative patterns.

  • •

    ESM is well-suited for sensitive topics by enabling in-the-moment data collection in natural settings.

  • •

    Tools like XPL facilitate ESM research by providing mobile-friendly forms, scheduling, and easy data export for analysis.

  • •

    Mixed methods pairing of ESM and qualitative interviews can be tailored by purposive sampling from the quantitative pool for deeper understanding.

Notable Quotes

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

"Experience sampling captures real-time lived experience repeatedly to examine patterns of change and growth."

"Balancing how often you signal someone and how many questions you ask is key to reduce participant fatigue."

"There are four trigger types: random, fixed, contextual, and self-initiated, each serving a unique purpose."

"This method has a degree of reactivity; paying attention to something may alter or change behavior."

"Preparation is key: pilot studies and a data analysis plan before launching ensure data quality and study success."

"Unstructured interviews are participant-controlled, spontaneous, and offer rich data but are less replicable."

"ESM improves ecological validity by collecting data in real-world situations as they occur."

"You can use experience sampling data to select a small qualitative sample to dive deeper in interviews."

"Never collect data that doesn’t specifically address your research question."

Ask the Rosenbot
Josh Clark
Sentient Design: New Design Patterns for New Experiences (3rd of 3 seminars)
2025 • Rosenfeld Community
Nalini P. Kotamraju
Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"
2021 • Advancing Research 2021
Gold
Alana Washington
(Remote) Service Design: A Transformation Case Study
2022 • Design at Scale 2022
Gold
Uday Gajendar
Leading through the long tail of trauma
2022 • Advancing Research Community
Uday Gajendar
Theme One Intro
2023 • Enterprise UX 2023
Gold
Nicole Bergstrom
AccessibilityOps: Moving beyond “nice to have”
2024 • DesignOps Community
Bria Alexander
Theme Two Intro
2022 • DesignOps Summit 2022
Gold
Llewyn Paine
Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
2025 • Advancing Research 2025
Gold
Aditi Ruiz
Pulse Check: Empathy Mapping Your Product Manager, Pt. 2
2022 • Design in Product 2022
Gold
Giff Constable
Financial fluency for product leaders: AMA with Giff Constable
2024 • Rosenfeld Community
Peter Levin
Solve a Problem Here, Transform a Strategy There: Research as an Occasion for Expanding Organizational Possibility
2024 • Advancing Research 2024
Gold
Jen Briselli
Learning Is The Engine: Designing & Adapting in a World We Can’t Predict
2025 • Rosenfeld Community
Ian Johnson
Latent Scope: Finding structure in unstructured data
2025 • Designing with AI 2025
Gold
Roberta Dombrowski
5 Reasons to Bring your Recruiting in House
2021 • DesignOps Summit 2021
Gold
Chris Geison
What is Research Strategy?
2021 • Advancing Research 2021
Gold
Jon Fukuda
Theme 3 Intro
2024 • DesignOps Summit 2024
Gold

More Videos

Marc Fonteijn

"Slow and intentional communication allows you to be fully present rather than distracted by constant notifications."

Marc Fonteijn Ru Butler

Increase your confidence, influence, and impact (through a Professional Community)

December 3, 2024

Dem Gerolemou

"Asking stupid questions can lead experts to reframe their thinking and improve the work."

Dem Gerolemou Alexis Oh Neef Rehman

Climate technology fundamentals

May 15, 2024

Daniela Magaña Flores

"Mobile users gave Amazon a higher Net Promoter Score than desktop users, indicating a better mobile experience."

Daniela Magaña Flores Ariane Rahn Jeff Ephraim Bander

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

March 10, 2022

Abbey Smalley

"Not growing the team was disheartening but led me to create training for partners to start taking a user-centered approach themselves."

Abbey Smalley Sylas Souza

Scaling UX Past the Size of Your Team

January 8, 2024

Patrick Commarford

"Before transitioning designers, we reviewed and agreed on a prioritized list with all executive leaders."

Patrick Commarford

Design Staffing for Impact

January 8, 2024

Xenia Adjoubei

"Data sovereignty is about who owns your data, which country’s laws apply, and how vulnerable groups are fairly protected."

Xenia Adjoubei Sean Bruce

Empowering Communities Through the Researcher in Residence Program

March 29, 2023

Craig Villamor

"Doing nothing is not a neutral act. Ignorance may be bliss, but it doesn’t absolve you from responsibility."

Craig Villamor

Design Systems for Ethical Design

January 26, 2023

Jon Fukuda

"A designer working on a new component needs to understand not just that component but the templates using it and overall approach."

Jon Fukuda Ellie Krysl

Design Planning and Management Support

October 3, 2023

Iain McMaster

"31% say design just executes product’s vision, 48% say product and design have different visions, only 21% say they work together towards shared goals."

Iain McMaster IHan Cheng

Design and Product: from Frenemy to Harmony

November 29, 2023