Rosenverse
Design and Analytics with Sarah Coyle

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Design and Analytics with Sarah Coyle

Thursday, July 30, 2020 • DesignOps Community
Share the love for this talk
Design and Analytics with Sarah Coyle
Speakers: Sarah Coyle
Link:

Summary

In this month's videoconference, Sarah Coyle chats with community curator Alison Rand and the DesignOps Community on: How to apply human centered design to analytics Types of measurement for design operations What to do if you don't have an analytics team

Key Insights

  • Measuring design value is impossible without clear context and defined questions.

  • Sarah transitioned from reactive data support to strategic design metrics development.

  • USAA’s design practice has nearly 300 people, centrally organized under one Chief Design Office.

  • Design operations at USAA includes analytics, recruiting, program management, and quality and risk.

  • Starting measurement with the question or goal leads to more meaningful data insights than starting with raw data.

  • Human-centered design principles improve the way analytics is approached and applied in design.

  • Education for both data creators and consumers is critical to mature design data practices.

  • Design research measurement focuses on whether research is happening and how it influences decisions.

  • Small teams without analysts can leverage passionate designers interested in analytics and cross-team collaboration.

  • Information (meaningful context-rich data) is more valuable than raw data points alone.

Notable Quotes

"I realized that measuring the value of design is an impossible question without context."

"Value of design is never going to get a single answer because you need the who, what, and why."

"I help teams start with questions about what they want to learn before looking at data."

"Data is just single points; information is making that data meaningful through context."

"Most requests started reactive but evolved into more strategic metric definitions."

"I train people on the difference between data and information and on asking the right questions."

"We are just starting to do regular and frequent reporting across the entire design organization."

"If you don’t have an analyst, find designers passionate about analytics and educate them."

"Human-centered design can bring curiosity and empathy into traditional analytics work."

"Information experience needs wayfinding so people can find and use data easily."

Ask the Rosenbot
Bram Wessel
Enterprise Information Architecture
2020 • Enterprise Community
Stefanie Owens
Optimizing for Outcomes: Transformation Design in Systems at Scale
2024 • Advancing Service Design 2024
Gold
Lukas Moro
“Feels Like Paper!”: Interfacing AI through Paper
2025 • Designing with AI 2025
Gold
Florence Okoye
AfroFuturism and UX Research
2023 • Advancing Research 2023
Gold
Kaaren Hanson
Stop Talking, Start Doing
2017 • Enterprise Experience 2017
Gold
Dr. Jamika D. Burge
The Future of Research: Bridging the Gaps
2021 • Advancing Research Community
Nicole Umphress
Delivering Design Education During a Global Pandemic: Lessons Learned
2022 • Design at Scale 2022
Gold
Paula Bach
Improving Legacy Software: How Much Better Does it Have to Be?
2022 • Advancing Research 2022
Gold
Harry Brignull
Beyond Clicks and Tricks: Why deceptive design has grown into a regulatory faultline
2026 • Rosenfeld Community
Sam Proulx
Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
2022 • DesignOps Summit 2022
Gold
Ana Ferreira
Designing Distributed: Leading Doist’s Fully Remote Design Team in Six Countries
2024 • DesignOps Summit 2020
Gold
Peter Van Dijck
Building impactful AI products for design and product leaders, Part 2: Evals are your moat
2025 • Rosenfeld Community
Leisa Reichelt
Opening Keynote: Operating in Context
2018 • DesignOps Summit 2018
Gold
Russell Blair
Killing the blank page
2024 • Designing with AI 2024
Gold
Nick Cochran
Growing in Enterprise Design through Making Connections
2019 • Enterprise Experience 2019
Gold
Steve Portigal
War Stories LIVE! Steve Portigal
2020 • Advancing Research 2020
Gold

More Videos

Alexandra Schmidt

"No one is born knowing how to facilitate; it takes training, observation, and practice."

Alexandra Schmidt

Enterprise UX Playbook

December 1, 2022

Jen Crim

"If you want to have tattoos, you can have tattoos and show them."

Jen Crim Jess Quittner Saritha Kattekola Alex Karr Gurbani Pahwa

Culture, DIBS & Recruiting

June 11, 2021

Christian Crumlish

"SAFe often turns UX into just digital or visual designers, which is wasteful and marginalizes valuable skills."

Christian Crumlish

AMA with Christian Crumlish, author of Product Management for UX People

March 24, 2022

Libby Maurer

"For women, they often won’t apply unless they meet all the bullet points in a job description."

Libby Maurer

Treating Diversity & Inclusion in Hiring as a Design Problem

December 5, 2019

Ali Jeffery

"Sustainability is not just about the environment, it’s about community."

Ali Jeffery Sheri Chudow

How DesignOps Helped Enable Wall Street to Work Remotely

October 22, 2020

Daniel Gloyd

"Daniel Day-Lewis went so far as to suffer three broken ribs immersing in his role for My Left Foot."

Daniel Gloyd

Designing From the Inside Out: How Method Acting Can Inspire Design Research

February 12, 2026

Kristin Skinner

"Equipped with the right tools, we can truly meet students where they are."

Kristin Skinner

Five Years of DesignOps

September 29, 2021

Johanna Kollmann

"Confirmation bias is when we ignore or explain away data that doesn’t support what we already believe - Nina Belk."

Johanna Kollmann

Insights-Driven Product Strategy: Get your Research to Count

December 6, 2022

David Sternberg

"Friction isn’t just annoying; it’s a force that reshapes behavior and can slow or stop user flow."

David Sternberg

Uncovering the hidden forces shaping user behavior

July 17, 2025