Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Atomizing Research: Trend or Trap

Gold
Monday, March 30, 2020 • Advancing Research 2020
Share the love for this talk
Atomizing Research: Trend or Trap
Speakers: Matt Duignan
Link:

Summary

There has been an explosion of interest in atomizing research, where researchers stop writing reports and instead tag individual insights in a database. The theory is that this will unlock your insights, making them findable and reusable. But does it work, and should you be doing the same? At Microsoft we tried it: Five years, 40,000 insights, 20+ research teams, and 17,000 unique users. So what have we learnt? We learnt that a structured insight library can be worth the effort. But we also learnt that atomizing insight can be taken too far. We learnt that context is critical. We learnt that short term efficiency is king, and that the required culture change is hard. And through this journey we’ve begun to discover how to blend atomized insight with your traditional research process.

Key Insights

  • Traditional research repositories often become burial grounds for insights, making it hard to find or connect reusable knowledge.

  • Shifting to atomic research focuses on individual insights as the fundamental unit rather than entire reports, enabling search, link, and remix.

  • Microsoft’s HITS system tracks dozens of thousands of insights connected across products like Windows, Xbox, and HoloLens.

  • Creating durable, reusable research insights requires overcoming strong human cognitive biases like hyperbolic discounting and in-group favoritism.

  • A culture of continuous curation and managerial priority is essential but challenging to maintain over time.

  • Immediate tactical value is key to motivating researchers to contribute to reusable knowledge rather than only producing one-off reports.

  • Allowing insights to emerge organically by observing reference patterns reduces complexity compared to rigid categorization of durable vs. raw observations.

  • Researchers and product teams benefit greatly from direct linking to specific insights and underlying evidence within their day-to-day workflows.

  • Handling conflicting insights involves encouraging researchers to collaborate and rationalize perspectives through syntheses rather than top-down arbitration.

  • The just-in-time curation approach folds creation and connection of reusable insights into immediate research tasks, reducing friction and cognitive load.

Notable Quotes

"Repository to me has a connotation of a place where stuff goes to sit and collect dust."

"What if the atomic unit of research wasn’t the reports, but it was the insight within those reports?"

"We wanted a living network of knowledge so yesterday’s insight connects to today’s evidence and tomorrow’s learning."

"Curation is super important, but also super hard."

"You have to push against 200,000 years of human evolution to get researchers to create reusable knowledge."

"Product teams want quick, grab-and-go research results, but reusable insights are more abstract and take longer to digest."

"Providing immediate tactical value is the big one for just-in-time curation."

"Standalone insights destroy the researcher’s ability to storytelling and engagement."

"Durable insights can emerge organically based on usage and referencing patterns in the system."

"The challenge is whether your organization has the energy to overcome cultural and technical barriers driving researchers back to disposable knowledge."

Ask the Rosenbot
Lona Moore
Scaling Design Beyond Designers
2021 • Design at Scale 2021
Gold
Joe Meersman
Use AI to Drive Outcomes that Go Beyond the Design Sprint
2024 • DesignOps Summit 2024
Gold
Victor Udoewa
Theme One Intro
2023 • Advancing Research 2023
Gold
Milan Guenther
A Shared Language for Co-Creating Ambitious Endeavours
2023 • Enterprise UX 2023
Gold
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Wendy Johansson
Design at Scale: Behind the Scenes
2021 • Enterprise Community
Dave Malouf
Panel: Design Systems and Documentation
2017 • DesignOps Summit 2017
Gold
Trisha Causley
[Demo] Complexity in disguise: Crafting experiences for generative AI features
2024 • Designing with AI 2024
Gold
Jackie Velasquez-Ross
Talent Acquisition and Our Responsibility
2020 • DesignOps Community
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • Design at Scale 2022
Gold
Alexis Lucio
Scaling Accessibility Through Design Systems
2022 • Design at Scale 2022
Gold
Kim Fellman Cohen
Measuring the Designer Experience
2019 • DesignOps Summit 2019
Gold
Tiffany Cheng
Designing in a Pandemic: Integrating Speed and Rigor
2022 • Design at Scale 2022
Gold
Robin Beers
Research as a Catalyst for Organizational Transformation
2021 • Advancing Research 2021
Gold
Jack Behar
How to Build Prototypes that Behave like an End-Product
2022 • Design in Product 2022
Gold
Lada Gorlenko
Theme 2 Intro
2022 • Design at Scale 2022
Gold

More Videos

Sheri Byrne-Haber

"Accessibility at scale can put you into the VUCA world – volatile, uncertain, complex, ambiguous."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Prayag Narula

"Feature bloat kills usability because it clouds the core value proposition."

Prayag Narula Hannah Hudson

Empowering Designers to do Good Research

March 11, 2022

Janelle Estes

"When I first started, I felt like I had this little superpower that nobody else really knew about."

Janelle Estes

UX Research Trends

January 28, 2021

Craig Brookes

"Content design is nascent and often misunderstood, but embedding content designers improves product clarity and usability."

Craig Brookes Andreas Huebner Morgan Quinn

"Just Make it Look Good" and Other Ways We're Misunderstood

June 11, 2021

Marc Fonteijn

"We design a community that would be missed if it were gone for our service design leaders."

Marc Fonteijn Ru Butler

Increase your confidence, influence, and impact (through a Professional Community)

December 3, 2024

Kate Towsey

"Engagement and impact roles bring creativity and help maintain team morale in otherwise dry operations work."

Kate Towsey

The State of ResearchOps: More Than Just Theory

June 20, 2019

Alla Weinberg

"Psychological safety is the foundation; without it you get a culture of transaction and silence."

Alla Weinberg

Design Teams Need Psychological Safety: Here’s How to Create It

September 9, 2022

Shawna Hein

"The collaboration cycle requires following standards for accessibility, content, design system usage, and IA or you don’t launch your product."

Shawna Hein Kevin Hoffman

Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts

November 17, 2022

Tricia Wang

"When ideas don't make it into the product, I do a post-mortem to share opportunities missed and improve the process."

Tricia Wang

SCALE: Discussion

June 15, 2018