Rosenverse
Standardizing Product Merits for Leaders, Designers, and Everyone

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Standardizing Product Merits for Leaders, Designers, and Everyone

Gold
Friday, June 15, 2018 • Enterprise Experience 2018
Share the love for this talk
Standardizing Product Merits for Leaders, Designers, and Everyone
Speakers: Jen Cardello
Link:

Summary

There is nothing more frustrating than dedicating your blood, sweat, and tears to developing a product, only to see it shut down for no particular reason. We still lack standards for measuring potential opportunities and solutions—so leadership continues to base decisions on intuition, personal experience, and other factors that often barely correlate with success. Organizations large and small need agreed-upon measures of potential product-market fit for their concepts and solutions, ones that help establish unmet needs and lead to designs that users understand and want to use.

The DesignOps team at Athenahealth has solved this problem by creating a standardized measurement framework—including qualitative and quantitative instruments—that helps product teams measure their concepts and solutions early and often. These are measures that leaders can use to make informed investment decisions across the larger portfolio, and that free product teams to be awesome at what they do: designing, managing, and developing products that lead to better experiences for users.

Key Insights

  • •

    Scale should be measured by the quality and meaningful impact of design, not just quantity or organizational reach.

  • •

    Lack of team agency in decision-making leads to unhealthy behaviors like cutting corners and skunk works projects.

  • •

    Athena Health flourished initially due to government-subsidized demand rather than superior user experience.

  • •

    Physicians using EHR systems often feel like clerks, frustrated by poor usability and forced workflows.

  • •

    Enterprise software delusion occurs when companies succeed despite poor design due to weak competition and high switching costs.

  • •

    Proving design impacts business outcomes requires identifying and analyzing key metrics like user retention and referrals.

  • •

    Creating a shared design language involving product managers and subject matter experts fosters organizational alignment.

  • •

    Systematic workflow audits guided by Jakob Nielsen’s heuristics can uncover actionable improvements to complex software.

  • •

    Redesigning product decision-making to empower teams early in the process accelerates better pivot, shelve, or proceed calls.

  • •

    Introducing self-serve experience measurement tools, including concept validation surveys, supports evidence-driven design iterations.

Notable Quotes

"Scale isn’t just about quantity, it’s about the quality and impact you have on organizational outcomes."

"So much change was killed just because leadership said so, and that really breaks my heart."

"Doctors don’t like using EHRs because it turns them into clerks; they’re engaging with a machine instead of a patient."

"You’re born on third base but think you hit a triple—that’s the enterprise software delusion."

"Users aren’t happy because they’re trapped; they have no sense of agency over the software they use."

"If design doesn’t move the needle, what needle are we even talking about? You have to find that needle."

"Creating a shared language lets others articulate design issues and makes design part of the conversation."

"Redesigning decision making means teams should have the autonomy to recommend pivot, shelve, or proceed earlier."

"We cut the claims editing process in half—four pages and 10 steps down to one page and four steps."

"Concept validation helps us spend time building useful things before making them work well."

Ask the Rosenbot
Jon Temple
Panel: Stacks, Security, and Stakeholders: The Hidden Work of UXR Tool Procurement
2026 • Advancing Research 2026
Gold
Andrew Michael
Building a Product Insights Team
2022 • Advancing Research 2022
Gold
Elena Naids
The Power of Difficult Conversations: A Case Study on How We Introduced Design Ops in the Federal Government Space
2023 • DesignOps Summit 2023
Gold
Jacqui Frey
Flow and Superfluidity for Design Orgs
2018 • DesignOps Summit 2018
Gold
Christian Crumlish
Introduction by our Conference Chair
2022 • Design in Product 2022
Gold
Elana Chapman
Getting started with accessibility research
2025 • Rosenfeld Community
Sara Conklin
A UXer’s 12-Month Journey from Climate Concern to Climate Credibility
2025 • Climate UX Interest Group
Sean Baker
Weaving Knowledge Management into the Fabric of Our Design Practice
2025 • DesignOps Summit 2025
Gold
Florence Okoye
AfroFuturism and UX Research
2023 • Advancing Research 2023
Gold
Gabriela Barneva
Operationalizing Inclusive Design in Service Design
2025 • Advancing Service Design 2025
Gold
Sam Proulx
SUS: A System Unusable for Twenty Percent of the Population
2021 • Design at Scale 2021
Gold
Simon Wardley
Maps and Topographical Intelligence
2019 • Enterprise Community
Sharon Bautista
Time to Make the Donuts: How User Research Helped Bridge Disparate Teams
2024 • Enterprise Experience 2020
Gold
Marina Martin
Lives on the Line: The Stakes of UX at the Scale of Government
2018 • Enterprise Experience 2018
Gold
Laura Smith
Embedding Service Design and Agile Practice within UK Planning Teams to Create Services that Last
2024 • Advancing Service Design 2024
Gold
Kristin Skinner
8 Types of Measures in Design Operations
2020 • DesignOps Community

More Videos

Corey Long

"Don’t read canned questions during interviews; make it conversational and human."

Corey Long

Hiring in DesignOps: A Critical Study on How to Hire and Get Hired

September 23, 2024

Gretchen Anderson

"Human-centered design is not just about your end users, it’s about the humans in your team."

Gretchen Anderson

Scaling the Human Center

June 8, 2017

Lori Muszynski

"No designer should ever work alone in part for this reason. You need to team apply your design."

Lori Muszynski Peter Merholz

Keeping Design Weird

October 2, 2023

Sam Proulx

"Expert screen reader users listen at over 300 words per minute and still fully understand the content."

Sam Proulx

SUS: A System Unusable for Twenty Percent of the Population

June 9, 2021

Prayag Narula

"Companies have started building their own base camps, but these feel more exclusionary compared to grassroots ones."

Prayag Narula Rida Qadri

HCI 2.0: Humanity Deserves the Attention that UX Research has to Offer

March 28, 2023

Deanna Smith

"More frequent change isn't always better; good communication and team pulse are key."

Deanna Smith

Leading Change with Confidence: Strategies for Optimizing Your Process

September 23, 2024

Lija Hogan

"Researchers have a lane enforcing best practice, but non-researchers can significantly contribute to creating intelligence."

Lija Hogan

Doing more with more: Lessons from the Front Lines of Democratization

March 9, 2022

Sam Proulx

"Accessibility is no longer considered something that someone else should do — it’s a first-party responsibility."

Sam Proulx

To Boldly Go: The New Frontiers of Accessibility

March 11, 2022

Bria Alexander

"Slack is a huge part of how we are going to be engaging in today’s conference."

Bria Alexander

Opening Remarks

October 3, 2023