Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Fishing for Real Needs: Reimagining Journalism Needs with AI

Gold
Tuesday, June 10, 2025 • Designing with AI 2025

This video is featured in the Designing with AI 2025 playlist and 2 more.

Share the love for this talk
Fishing for Real Needs: Reimagining Journalism Needs with AI
Speakers: Patrick Boehler
Link:

Summary

Our team at Gazzetta, a media research lab, is tackling a fundamental challenge in journalism: the disconnect between media output and community needs, particularly in restricted or distorted information environments of autocracies. We have learnt over the past years that traditional audience research has led to quant-heavy, superficial understanding, ineffective content and, ultimately, irrelevance. To address this problem, we have developed a three-stage process using AI knowledge bases to build empathy, map information needs, and analyze information flows. We have used this process to systematically review multiple information sources to build deep community understanding before product development. This methodology has helped us preserve nuance, identify knowledge gaps, and assign confidence levels to findings. Rather than treating AI as a black box solution, a thoughtful process-oriented approach can help us better understand and serve information needs, and gradually rebuild relevance.

Key Insights

  • AI combined with structured research queries reveals deeper insights than traditional research when direct user access is limited.

  • Misalignment often exists between what organizations believe users need and what users actually need, as shown by North Korean fishermen preferring weather forecasts over political news.

  • Traditional engagement metrics only measure surface behavior, failing to capture true user information needs and satisfaction.

  • A shift from a theory of change (assuming known needs) to a theory of service (starting with understanding actual needs) is fundamental to effective media strategy and user-centered design.

  • A three-stage research approach—building empathy, prioritizing information gaps, and analyzing information flows—helps systematically leverage complex and scattered data.

  • Confidence rating of sources and insights is essential to prevent false certainty from AI-generated outputs.

  • Structured queries and systematic frameworks outperform opportunistic or freeform AI interactions, avoiding common pitfalls like overgeneralization and poor prompt design.

  • Human expertise, especially cultural knowledge, is indispensable to interpret AI outputs and maintain nuance.

  • Research repositories often hold untapped treasure troves of insights that, with structure and AI, can be mined even on shoestring budgets.

  • Visual coding of insights by confidence level improves transparency and decision-making among stakeholders.

Notable Quotes

"Journalists like me are in the business of interrogating reality to get at the truth."

"Those fishermen didn’t want political news—they wanted reliable weather forecasts to stay safe at sea."

"We spend millions on content that nobody wanted and that didn’t actually help people navigate their lives."

"Traditional metrics create a dangerous illusion where we optimize for what we can measure, not what people actually need."

"We’re moving from theory of change to theory of service: starting with what people actually need before creating anything."

"The careful application of structured queries can reveal deeper insights than traditional research alone."

"AI systems can present speculative connections as established facts, so confidence ratings are critical."

"Structure beats free form interaction—systematic query frameworks are essential to avoid pitfalls."

"Humans remain essential for evaluation, especially to interpret cultural nuance that AI often misses."

"Finding meaningful insights is not just casting a wide net—it requires discipline, structure, and knowing where to fish."

Ask the Rosenbot
Louis Rosenfeld
Discussion: What Operations can teach DesignOps
2017 • DesignOps Summit 2017
Gold
Matt Duignan
Atomizing Research: Trend or Trap
2020 • Advancing Research 2020
Gold
Peter Van Dijck
Hands-on AI #2: Understanding evals: LLM as a Judge
2025 • Rosenfeld Community
Megan Blocker
Day 2 Theme Panel
2025 • Advancing Research 2025
Gold
Sarah Barrett
The "How" of Enterprise Information Architecture
2023 • Enterprise UX 2023
Gold
Dave Malouf
Theme 3: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
Kit Unger
Theme 2: Introduction
2021 • Design at Scale 2021
Gold
Jeff Gothelf
Innovation Studios: the Engines of Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
Bria Alexander
Opening Remarks Day 1
2024 • Advancing Research 2024
Gold
Landon Barnes
Are My Research Findings Actually Meaningful?
2022 • Advancing Research 2022
Gold
Victor Udoewa
Research in the Pluriverse
2023 • Advancing Research 2023
Gold
Alnie Figueroa
The Future of Design Operations: Transforming Our Craft
2025 • DesignOps Summit 2025
Gold
Frances Yllana
DesignOps Exposed: What do our peers really think of us?
2025 • DesignOps Summit 2025
Gold
Gabriela Barneva
Operationalizing Inclusive Design in Design Ops
2025 • DesignOps Summit 2025
Gold
Bud Caddell
Theme 2 Intro
2021 • DesignOps Summit 2021
Gold
Francesca Barrientos, PhD
You Need Your Own Definition of Design Maturity
2022 • Design at Scale 2022
Gold

More Videos

Sheri Byrne-Haber

"Assistive technology has to communicate with the destination, that’s your website or product."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Prayag Narula

"Empathy isn't just kindness, it's the lens through which we see users' true motivations."

Prayag Narula Hannah Hudson

Empowering Designers to do Good Research

March 11, 2022

Janelle Estes

"The UX team is never the keeper of all knowledge of the customer; the whole company owns the experience."

Janelle Estes

UX Research Trends

January 28, 2021

Craig Brookes

"Collaboration without ego is key to building the right product, not just what one's own interests are."

Craig Brookes Andreas Huebner Morgan Quinn

"Just Make it Look Good" and Other Ways We're Misunderstood

June 11, 2021

Marc Fonteijn

"Everyone goes through quite an extensive application process, but it was stress-free and informal."

Marc Fonteijn Ru Butler

Increase your confidence, influence, and impact (through a Professional Community)

December 3, 2024

Kate Towsey

"The longer you take to recognize research ops and scale your team, the harder it becomes to amplify the value of your research investment — Carrie, Booking.com."

Kate Towsey

The State of ResearchOps: More Than Just Theory

June 20, 2019

Alla Weinberg

"When we’re not safe, our thinking brain — the neocortex — shuts down and operating IQ drops by half."

Alla Weinberg

Design Teams Need Psychological Safety: Here’s How to Create It

September 9, 2022

Shawna Hein

"Slack channels and weekly meetings encourage cross-contract collaboration, avoiding duplication and sharing learnings across teams."

Shawna Hein Kevin Hoffman

Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts

November 17, 2022

Tricia Wang

"You have to look two or three steps ahead so you're not chasing what's right in front of you — avoid target fixation."

Tricia Wang

SCALE: Discussion

June 15, 2018