Rosenverse
Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”

Wednesday, November 13, 2024 • DesignOps Community
Share the love for this talk
Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”
Speakers: Saara Kamppari-Miller , Nicole Bergstrom and Shashi Jain
Link:

Summary

Why do so many metrics include the word “Key”? How do those metrics differ, and how do teams and organizations decide which key metric is best for them? Join this DesignOps community discussion to compare different types of three letter acronym metrics such as KPI, KEI, and KSP (Key Performance Indicator, Key Experience Indicator, and Key Strategic Priorities). And let's not forget OKR's (Objectives and Key Results)!

Key Insights

  • •

    Nicole emphasizes linking accessibility initiatives to corporate Key Strategic Priorities to demonstrate business value beyond compliance.

  • •

    Shashi's KPI Compass framework categorizes innovation metrics into quadrants balancing leading/lagging and thought leadership/impact.

  • •

    Key Experience Indicators (KEIs) are distinct from KPIs and focus on user-centered measures that predict experience failure risks.

  • •

    Measuring behavior change is crucial to predicting innovation success, not just tracking final business metrics.

  • •

    Consistency in metrics terminology and templates across teams helps avoid sidetracking conversations with engineering partners.

  • •

    Canary indicators identify critical experience fail points that can doom a product if not monitored carefully.

  • •

    Strategic priorities, like Hilton’s KSPs, tend to remain stable over years to guide multi-year initiatives reliably.

  • •

    Storytelling and communication training are vital for teams to convey the value of accessibility and design work aligned with business objectives.

  • •

    In ambiguous or innovative contexts, metrics should remain a conversation starter rather than imposed fixed covenants.

  • •

    Using user and market feedback can shift early metrics from vanity measures (like downloads) to meaningful adoption and usage data.

Notable Quotes

"If we are working on something that does not ladder up to our KSPs, then we should not be working on it."

"The canary in the coal mine—that’s how we identify the fail points in the user experience we absolutely can’t miss."

"Innovation is invention multiplied by adoption multiplied by inclusion."

"Metrics are always a conversation, they shouldn’t be a covenant."

"Adoption is the only thing that matters in innovation. If you’re not changing behavior, you haven’t innovated."

"Key is a reminder that these metrics reflect what is authoritative and important to the customer and the business."

"If you only measure vanity metrics like downloads, you risk tracking numbers that don’t translate to real usage or value."

"Our KSPs do not change year over year because changing them frequently is disruptive for the business direction."

"We use storytelling to turn accessibility from just compliance into a business differentiator that executives care about."

"When there’s dispute over what to measure, use that as an opportunity to discuss the behavior you want to change and the value capture."

Ask the Rosenbot
Mohammad Hossein Jarrahi
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
2023 • QuantQual Interest Group
Tala Tayebi
Voice and influence in an age of noise
2026 • Advancing Research 2026
Gold
Ned Dwyer
The Future of DesignOps is Tool Consolidation
2024 • DesignOps Summit 2024
Gold
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • Design at Scale 2022
Gold
Dantley Davis
Leadership & Diversity—A Fireside Chat with Dantley Davis
2020 • Enterprise Community
Husani Oakley
Bias Towards Action: Building Teams that Build Work
2018 • Enterprise Experience 2018
Gold
Saara Kamppari-Miller
Theme Three Intro
2023 • DesignOps Summit 2023
Gold
Kaaren Hanson
Stop Talking, Start Doing
2017 • Enterprise Experience 2017
Gold
Gretchen Anderson
Scaling the Human Center
2017 • Enterprise Experience 2017
Gold
Kwabena Opoku
Methodological toolkit for unique research impact
2026 • Advancing Research 2026
Gold
Peter Van Dijck
Building impactful AI products for design and product leaders, Part 2: Evals are your moat
2025 • Rosenfeld Community
Darian Davis
Lessons from a Toxic Work Relationship
2024 • Enterprise Experience 2020
Gold
Christian Crumlish
The Pygmalion Effect: In Which a Vibe Coding Experiment Becomes a Million Lines…
2025 • Rosenfeld Community
Nicole Bergstrom
AccessibilityOps: Moving beyond “nice to have”
2024 • DesignOps Community
Joshua Graves
We Need To Talk: Managing Ludicrous Requests at Work (Part 3 of 3)
2025 • Rosenfeld Community
Abbey Smalley
Scaling UX Past the Size of Your Team
2024 • Enterprise Experience 2020
Gold

More Videos

Mark Interrante

"Think of AI not as a magic eight ball, but as a highly educated intern that can help with routine tasks."

Mark Interrante Harry Max

AI for Prioritization (3rd of 3 seminars)

July 11, 2024

Patrizia Bertini

"No VP or director has direct responsibility at board level. It’s the C-executives who ultimately decide."

Patrizia Bertini

The (r)evolution of designOps: It’s Time to Think (really) BIG

September 11, 2025

Shan Shen

"We prioritize to code switch to clarify value and relevance using language as a tool for meaningful activities."

Shan Shen

Translating UX Terms into Business Contexts

November 29, 2023

Adam Thomas

"Most decisions are coin flip decisions—easily reversible and should be treated as defaults."

Adam Thomas

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

December 6, 2022

Robin Beers

"Turning the research lens on both the ‘in here’ organization and the ‘out there’ customer reality helps reveal misalignments and opportunities."

Robin Beers

Research as a Catalyst for Organizational Transformation

March 12, 2021

Sheri Byrne-Haber

"Getting something accessible is a straight line; keeping something accessible requires process change."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Joseph Meersman

"Critiques help teams stop being the lone ranger and instead iterate faster together with purpose and clarity."

Joseph Meersman

Sweating the Pixel: Scaling Quality through Critique

June 10, 2021

Deanna Washington

"You gotta write that charter to get clarity with your team."

Deanna Washington Bria Alexander Jon Fukuda Saara Kamppari-Miller Farid Sabitov

Connecting the Ops: Plenary Panel and Closing Circle

September 9, 2022

Aaron Stienstra

"Reflecting on our power as implementers of policy, we must reciprocate by giving back information and value to those we engage."

Aaron Stienstra Lashanda Hodge

Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government

December 8, 2021