Designing Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning
Summary
Why do people form Meaningful Connections™ with some type of audio content, but not all, and how do we ensure that our ML models respect the nuances of what makes listening to music and podcasts enjoyable? This talk will shed light on such topics and leave the audience with ideas, challenges and possible best practices for using Mixed Methods Research in the age of ML to build delightful product experiences.
Key Insights
-
•
Machine learning has shifted from backend tech to a frontline role shaping consumer experiences like music recommendations.
-
•
Spotify personalizes not just music content but also merchandising and UI elements like playlist covers and home screen layout.
-
•
Music preferences are deeply contextual, changing by time of day, activity, and listener persona.
-
•
The assumption that skipping a song is a purely negative signal is often incorrect; skip behavior varies by user goals and trust.
-
•
Mixed methods research at Spotify combines data science, qualitative user research, and now increasingly machine learning itself.
-
•
Personas such as 'Nick' (curators) and 'Shelley' (casual listeners) help segment skip behaviors and user needs effectively.
-
•
Editorial playlists blend human curation with ML personalization, balancing communal music experience and individual taste.
-
•
Contextual factors, including social and environmental considerations, greatly influence music listening behavior and signal interpretation.
-
•
User mental models around music and playlists differ significantly across personas and impact engagement and skipping.
-
•
User research teams at Spotify have grown significantly, highlighting the rising importance of research in ML-driven product development.
Notable Quotes
"Machine learning used to be backend technology, but now millions of consumer experiences are decided by machines or algorithms."
"These playlists have some element of machines recommending music in addition to editors behind the scenes."
"There’s been a fundamental shift in consumer products in the last five years driven by machine learning."
"Skipping a song is one of the most common user behaviors and is often assumed to be a bad thing."
"We showed that a skip is not a skip — it varies based on listener goals and trust in the playlist."
"Human behavior is complex and machine learning models need to understand those nuances."
"We consider machine learning as the third leg of mixed methods research, alongside data science and user research."
"Music is personal but also cultural and communal, which creates complexity for personalization."
"Personas like Nick and Shelley help us understand different user attitudes towards music listening and skipping."
"There hasn’t been a better time to be a user researcher, especially in machine learning enabled experiences."
Or choose a question:
More Videos
"We design a community that would be missed if it were gone for our service design leaders."
Marc Fonteijn Ru ButlerIncrease your confidence, influence, and impact (through a Professional Community)
December 3, 2024
"Most of the primitives of how you do work are portable to climate tech from other industries."
Dem Gerolemou Alexis Oh Neef RehmanClimate technology fundamentals
May 15, 2024
"Mobile users gave Amazon a higher Net Promoter Score than desktop users, indicating a better mobile experience."
Daniela Magaña Flores Ariane Rahn Jeff Ephraim BanderAhead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
March 10, 2022
"I met with my partners and leaders to really dig into their hopes, fears, and dreams about where they wanted to go."
Abbey Smalley Sylas SouzaScaling UX Past the Size of Your Team
January 8, 2024
"If you’re like us, you’d love to have 100% of the UX talent every project needs, but your team isn’t large enough."
Patrick CommarfordDesign Staffing for Impact
January 8, 2024
"The Researcher in Residence program invites members of affected communities to use our tools over a funded three-month period pro bono."
Xenia Adjoubei Sean BruceEmpowering Communities Through the Researcher in Residence Program
March 29, 2023
"Make it easy to do the right thing, and as a side effect, make it harder to do the wrong thing."
Craig VillamorDesign Systems for Ethical Design
January 26, 2023
"The missing hub is the design planning and management tool."
Jon Fukuda Ellie KryslDesign Planning and Management Support
October 3, 2023
"Knowing your teammates personally helps in remote settings, especially for encouraging shy or quiet engineers to engage."
Iain McMaster IHan ChengDesign and Product: from Frenemy to Harmony
November 29, 2023
