Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

User Science: Product Analytics & User Research

Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
User Science: Product Analytics & User Research
Speakers: Marieke McCloskey
Link:

Summary

Want to help make better product decisions? You've got to combine qualitative human insights from user research with data analytics and experimentation. Too often research questions are "sent to the team that can answer them best." Questions about how many users do something goes to analytics, questions about which design might work better goes to user research. But what if you partnered with those other teams to answer the questions together? In this session Marieke will share how, as a qualitative UX researcher she's partnered with analysts to identify high-growth opportunities and gain a deeper understanding of users.

Key Insights

  • User science combines qualitative user research and data science to generate more impactful product insights.

  • Early collaboration between UX researchers and data teams helps reconcile conflicting insights and builds stronger shared understanding.

  • Curious and thoughtful data partners who care about the people behind the data are essential collaborators.

  • Developing a shared engagement metric like an activity score can help narrow research focus and create common language.

  • UX researchers’ storytelling and cross-functional skills position them uniquely to lead collaboration with data teams.

  • Opportunity solution trees provide a useful framework for aligning product goals, user problems, and possible solutions across teams.

  • Ethical concerns about striving for more engagement should be constantly revisited; more use is not always better.

  • Employee experience and customer experience research share many metrics and methods and can inform one another.

  • Proactive collaboration can transform narrow data or qualitative projects into comprehensive, actionable research.

  • Transparency about knowledge limits and honest communication enable trust and effective collaboration between UX and data teams.

Notable Quotes

"If you’re a person who studies people, then you’re a person who understands data."

"Typically we get stuck answering the questions we know we can answer but lose the chance to see the big picture."

"I think we as UX researchers are uniquely positioned to forge bonds with data teams because of our storytelling and cross-functional work."

"Finding out more about these most active users is a key priority this year, said our CEO at the board presentation."

"We can’t be there for every behavior after the nudge, nor do we necessarily want to be."

"Less than a third of respondents feel like they work somewhere with a clear investment in customer-driven decision making."

"You might find that spending the most time getting people interested in collaboration is where the work really happens."

"I invited Mark to a user interview — he had no idea interviewing wasn’t for him but respected that skill deeply."

"We are really good at finding problems, but the opportunity solution tree helps pick the best ones to focus on."

"Sharing your research skills broadly within your company can create unexpected opportunities to improve experiences."

Ask the Rosenbot
Carol Smith
Operationalizing Responsible, Human-Centered AI
2023 • Enterprise UX 2023
Gold
Ed Mullen
Designing the Unseen: Enabling Institutions to Build Public Trust
2022 • Civic Design 2022
Gold
Louis Rosenfeld
How AI will Change DesignOps Tooling
2023 • DesignOps Summit 2023
Gold
Allison Sanders
Operating with Purpose
2024 • DesignOps Summit 2020
Gold
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • Design at Scale 2022
Gold
Laurent Christoph
Scale the impact of DesignOps in 3D: Diligence, Decision, Discipline
2025 • DesignOps Community
Peter Merholz
Design at Scale is People!
2021 • Design at Scale 2021
Gold
Kathleen Asjes
Research Democratization: the Good, the Bad and the Ugly
2022 • Advancing Research 2022
Gold
Panel Discussion: Communicating the Value of DesignOps
2018 • DesignOps Summit 2018
Gold
Prayag Narula
Dialing for Research: How to Reach the Unreachable
2022 • Advancing Research 2022
Gold
Louis Rosenfeld
Discussion: What Operations can teach DesignOps
2017 • DesignOps Summit 2017
Gold
Jim Kalbach
Jobs To Be Done
2021 • Enterprise Community
Wyatt Hayman
Global Research Panels
2020 • DesignOps Community
Mike Brzozowski
UX in everyday products: Empowering climate conscious choices
2024 • Climate UX Interest Group
Kate Kalcevich
Integrating Accessibility in DesignOps
2024 • DesignOps Summit 2024
Gold
Etienne Fang
Power of Insights: Why sharing is better than silos with Uber’s Insights Platform
2019 • Advancing Research Community

More Videos

Sheri Byrne-Haber

"Keeping something cloud-based accessible is the most complicated because of hundreds of releases per day in continuous integration."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Prayag Narula

"If you skip iterative testing, you risk building features nobody really wants."

Prayag Narula Hannah Hudson

Empowering Designers to do Good Research

March 11, 2022

Janelle Estes

"The hardest skill to recruit for is someone who can consult and ask the right questions to uncover what the request really is."

Janelle Estes

UX Research Trends

January 28, 2021

Craig Brookes

"If you are spinning trying to make words work over and over, you likely have an interaction problem, not a word problem."

Craig Brookes Andreas Huebner Morgan Quinn

"Just Make it Look Good" and Other Ways We're Misunderstood

June 11, 2021

Marc Fonteijn

"Slow and intentional communication allows you to be fully present rather than distracted by constant notifications."

Marc Fonteijn Ru Butler

Increase your confidence, influence, and impact (through a Professional Community)

December 3, 2024

Kate Towsey

"Research ops allows me to indulge my geeky planning spreadsheety side as well as my people-loving supportive side — Saskia, Delivery."

Kate Towsey

The State of ResearchOps: More Than Just Theory

June 20, 2019

Alla Weinberg

"When we’re not safe, our thinking brain — the neocortex — shuts down and operating IQ drops by half."

Alla Weinberg

Design Teams Need Psychological Safety: Here’s How to Create It

September 9, 2022

Shawna Hein

"A government designer aims to reduce UX variation while a contractor may optimize only their single product, creating potential conflicts."

Shawna Hein Kevin Hoffman

Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts

November 17, 2022

Tricia Wang

"Positive mutual regard helps uncover root causes behind people’s behaviors to build collaboration rather than combat."

Tricia Wang

SCALE: Discussion

June 15, 2018