Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Data-Prompted Interviews

Friday, December 17, 2021 • QuantQual Interest Group
Share the love for this talk
Data-Prompted Interviews
Speakers: Amelia Cole
Link:

Summary

In this session, Amelia unpacks data-prompted interviews with an emphasis on Experience Sampling Methods. You will learn the essentials of running an Experience Sampling study and how to use quantitative data during interviews to enhance our understanding of daily life activities and experiences.

Key Insights

  • Data prompted interviews use participants’ own quantitative data to guide qualitative exploration, enhancing insight depth.

  • Experience Sampling Methods capture real-time, repeated snapshots of participants’ thoughts and actions to track temporal patterns.

  • Balancing sampling frequency, survey length, and study duration is critical to avoid participant fatigue in longitudinal ESM studies.

  • Four trigger types in ESM—random, fixed, contextual, and self-initiated—serve distinct research purposes.

  • High attrition and resource intensity are common challenges in ESM, necessitating careful preparation and participant engagement.

  • Reactivity, where participants alter behavior due to observation, is an inherent feature of ESM and can enhance participant metacognition.

  • Unstructured interviews following ESM offer participant-controlled, rich narratives that reveal the why behind quantitative patterns.

  • ESM is well-suited for sensitive topics by enabling in-the-moment data collection in natural settings.

  • Tools like XPL facilitate ESM research by providing mobile-friendly forms, scheduling, and easy data export for analysis.

  • Mixed methods pairing of ESM and qualitative interviews can be tailored by purposive sampling from the quantitative pool for deeper understanding.

Notable Quotes

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

"Experience sampling captures real-time lived experience repeatedly to examine patterns of change and growth."

"Balancing how often you signal someone and how many questions you ask is key to reduce participant fatigue."

"There are four trigger types: random, fixed, contextual, and self-initiated, each serving a unique purpose."

"This method has a degree of reactivity; paying attention to something may alter or change behavior."

"Preparation is key: pilot studies and a data analysis plan before launching ensure data quality and study success."

"Unstructured interviews are participant-controlled, spontaneous, and offer rich data but are less replicable."

"ESM improves ecological validity by collecting data in real-world situations as they occur."

"You can use experience sampling data to select a small qualitative sample to dive deeper in interviews."

"Never collect data that doesn’t specifically address your research question."

Ask the Rosenbot
Gretchen Anderson
Scaling the Human Center
2017 • Enterprise Experience 2017
Gold
Alison Rand
Scaling Impact with Service Design
2021 • DesignOps Community
Bria Alexander
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Tess Dixon
C'mon Get Happy
2021 • DesignOps Summit 2021
Gold
Wendy Johansson
An Education on Design Education for Orgs
2021 • Design at Scale 2021
Gold
Chelsea Mauldin
Let's Talk About Money
2022 • Civic Design 2022
Gold
Jill Fruchter
Inconvenient Insights: The Researcher's Role is to Stay Curious
2023 • Advancing Research 2023
Gold
Nicole Umphress
Delivering Design Education During a Global Pandemic: Lessons Learned
2022 • Design at Scale 2022
Gold
Sam Proulx
Mobile Accessibility and You
2022 • Design at Scale 2022
Gold
Deirdre Hirschtritt
Research is Only as Good as the Relationships You Build
2022 • Civic Design 2022
Gold
Séamus Byrne
Aligning Teams with Choreography
2024 • Enterprise Experience 2020
Gold
Robin Beers
Beyond Insights: Researchers as Organizational Change Catalysts
2024 • Advancing Research 2024
Gold
Josh Clark
Sentient Scenes and Radically Adaptive Experiences
2025 • Designing with AI 2025
Gold
Megan Campos
What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
2021 • Advancing Research 2021
Gold
Corey Nelson
Layoffs
2022 • Advancing Research Community
Anna Avrekh
Expert Panel: Leading in and with Research
2022 • Advancing Research 2022
Gold

More Videos

Jim Kalbach

"Having big ears means listening more to others than to yourself during a performance."

Jim Kalbach

Jazz Improvisation as a Model for Team Collaboration

November 6, 2017

Louis Rosenfeld

"People saying you should write a book is nice, but it’s not the real reason you should write one."

Louis Rosenfeld

Coffee with Lou: Should You Write a (UX) Book?

March 7, 2024

Catt Small

"I kind of think of it one as like fields of influence — staff influences the team or pillar, principal influences organization-wide."

Catt Small Micah Bennett Brian Carr Jessica Harllee

What's Next for ICs: Exploring Staff and Principal Designer Roles

February 22, 2024

Marieke McCloskey

"If you’re a person who studies people, then you’re a person who understands data."

Marieke McCloskey

User Science: Product Analytics & User Research

March 11, 2021

Llewyn Paine

"Even if you’re not doing facial recognition, storing face and voice data is under growing legal scrutiny."

Llewyn Paine

[Demo] Deploying AI doppelgangers to de-identify user research recordings

June 5, 2024

Joshua Noble

"If you cannot remove a treatment, it may not be a true cause."

Joshua Noble

Casual Inference

October 6, 2023

Sara Logel

"We’re biologically wired to respond to intellectual challenges the same way as physical threats."

Sara Logel

Your Colleagues are Your Users Too

March 29, 2023

Bria Alexander

"We'll have a centralized Slack channel for all discussion to come together as one community."

Bria Alexander Louis Rosenfeld

Welcome

January 8, 2024

Sam Proulx

"We often say don’t make me think. When that’s not possible, reuse and recycle those learnings."

Sam Proulx

Online Shopping: Designing an Accessible Experience

June 7, 2023