Rosenverse
Data-Prompted Interviews

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Data-Prompted Interviews

Friday, December 17, 2021 • QuantQual Interest Group
Share the love for this talk
Data-Prompted Interviews
Speakers: Amelia Cole
Link:

Summary

In this session, Amelia unpacks data-prompted interviews with an emphasis on Experience Sampling Methods. You will learn the essentials of running an Experience Sampling study and how to use quantitative data during interviews to enhance our understanding of daily life activities and experiences.

Key Insights

  • Data prompted interviews use participants’ own quantitative data to guide qualitative exploration, enhancing insight depth.

  • Experience Sampling Methods capture real-time, repeated snapshots of participants’ thoughts and actions to track temporal patterns.

  • Balancing sampling frequency, survey length, and study duration is critical to avoid participant fatigue in longitudinal ESM studies.

  • Four trigger types in ESM—random, fixed, contextual, and self-initiated—serve distinct research purposes.

  • High attrition and resource intensity are common challenges in ESM, necessitating careful preparation and participant engagement.

  • Reactivity, where participants alter behavior due to observation, is an inherent feature of ESM and can enhance participant metacognition.

  • Unstructured interviews following ESM offer participant-controlled, rich narratives that reveal the why behind quantitative patterns.

  • ESM is well-suited for sensitive topics by enabling in-the-moment data collection in natural settings.

  • Tools like XPL facilitate ESM research by providing mobile-friendly forms, scheduling, and easy data export for analysis.

  • Mixed methods pairing of ESM and qualitative interviews can be tailored by purposive sampling from the quantitative pool for deeper understanding.

Notable Quotes

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

"Experience sampling captures real-time lived experience repeatedly to examine patterns of change and growth."

"Balancing how often you signal someone and how many questions you ask is key to reduce participant fatigue."

"There are four trigger types: random, fixed, contextual, and self-initiated, each serving a unique purpose."

"This method has a degree of reactivity; paying attention to something may alter or change behavior."

"Preparation is key: pilot studies and a data analysis plan before launching ensure data quality and study success."

"Unstructured interviews are participant-controlled, spontaneous, and offer rich data but are less replicable."

"ESM improves ecological validity by collecting data in real-world situations as they occur."

"You can use experience sampling data to select a small qualitative sample to dive deeper in interviews."

"Never collect data that doesn’t specifically address your research question."

Ask the Rosenbot
Mark Interrante
Collaboration Flows in Product Development
2017 • Enterprise Experience 2017
Gold
Bria Alexander
Charting the future of DesignOps: A community workshop
2024 • DesignOps Community
Meredith Black
Building Community and Common Trends to Look for in 2021
2020 • DesignOps Community
Kit Unger
Theme 3 Intro
2022 • Design at Scale 2022
Gold
Rachael Dietkus, LCSW
Leading through the long tail of trauma
2022 • Advancing Research Community
Rima Campbell
Increase Productivity and Drive Business Impact
2024 • DesignOps Summit 2024
Gold
Dave Malouf
Panel: Design Systems and Documentation
2017 • DesignOps Summit 2017
Gold
Louis Rosenfeld
Coffee with Lou
2024 • Rosenfeld Community
Briana Thomas
The Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams
2024 • DesignOps Summit 2024
Gold
George Zhang
UX Research Excellence Framework
2021 • Advancing Research 2021
Gold
Jacqui Frey
Setting the Table for Dynamic Change
2019 • DesignOps Summit 2019
Gold
Aiyana Bodi
Three Key Climate Initiatives and How You Can Help
2024 • Climate UX Interest Group
Prayag Narula
HCI 2.0: Humanity Deserves the Attention that UX Research has to Offer
2023 • Advancing Research 2023
Gold
Joanna Vodopivec
One Research Team for All - Influence Without Authority
2022 • Advancing Research 2022
Gold
Amber Knabl
Empowering innovation: The critical role of inclusive product development in the AI era
2024 • Designing with AI 2024
Gold
Bassel Deeb
Do More With Less: Equip and Lead Design Orgs Through Adversity
2023 • DesignOps Summit 2023
Gold

More Videos

Louis Rosenfeld

"If you want to make this conference better for you, just let us know in Slack — we want you to have a positive experience."

Louis Rosenfeld Bria Alexander

Day 1 Welcome

September 23, 2024

Lisa Gironda

"If you don’t have 10 minutes to meditate a day, you actually need to meditate for an hour."

Lisa Gironda

Opener: Chief of Staff–An unexpected journey

January 8, 2024

Jamie Beck Alexander

"The climate doesn’t need everyone to go work in climate NGOs; we need everyone to find a climate angle from wherever they sit."

Jamie Beck Alexander Nina Gregg Shawn Petersen Bill DeRouchey

How can you find your role in climate?

January 17, 2024

Iram Shah

"An intelligent person understands what is being said; a wise person understands what is left unsaid."

Iram Shah

Closing Keynote: The View from the Top

June 4, 2019

Melinda Belcher

"Consultants can do things insiders can’t because they have more liberty to ask awkward questions and push boundaries."

Melinda Belcher

Insider preview of Enterprise Experience 2020

May 28, 2020

Natalia Radywyl

"Studio Thick’s name refers to thick value — qualitative research with more depth than simple messages."

Natalia Radywyl

Co-Designing New Power in Australia's Public Sector

November 16, 2022

Uday Gajendar

"Creative provocation isn’t about building those crazy ideas but opening space for questioning assumptions."

Uday Gajendar

The Rise of Meta-Design: A Starter Playbook

May 19, 2022

Jesse Zolna

"There’s no half-assing it. If you want to be involved in developing solutions, you better have significant client exposure."

Jesse Zolna

Inviting the Whole Org to Come See For Yourself

March 30, 2020

Steve Baty

"Communication over communication and creating safe spaces for people to disagree leads to healthy exchanges and minimizes detractors."

Steve Baty Richard Dalton Maria Giudice Harry Max

Discussion

June 9, 2016