Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Why Changing Hearts & Minds Doesn’t Work When Promoting DE&I Efforts, but Checklists Do

Gold
Wednesday, October 4, 2023 • DesignOps Summit 2023
Share the love for this talk
Why Changing Hearts & Minds Doesn’t Work When Promoting DE&I Efforts, but Checklists Do
Speakers: Theresa Slate and Erin Robertson
Link:

Summary

Across the industry, design teams are focused on growing and supporting a diverse workforce. But current efforts are often unsuccessful —?and despite an increase in time, effort and money behind organization’s DE&I efforts, most teams remain unchanged (and very white). To truly address bias and support diversity efforts, teams need to stop focusing on feelings and instead create hiring and performance review systems that prevent individuals from acting on their bias. As a Design Enablement and Operations practice, we have worked with designers and their teams to build practices that standardize hiring criteria and reduce the impact of individuals’ bias and racism. In this workshop, we will work together to: Define tangible core competencies that define each job and the criteria hiring and performance are measured on Create a Portfolio Review “Cheat Sheet” that allows a team to review a candidate with an anti-bias approach Review examples of performance review and correct instances of bias

Key Insights

  • Initial DEI efforts focused on changing hearts and minds often lead to burnout without measurable impact.

  • Bias in hiring decisions can manifest as unequal standards for candidates based on race and gender.

  • Creating a set of 12 core competencies helped objectively define key skills across multiple design roles.

  • Focusing on action-oriented 'I can' competencies over subjective knowledge helped reduce bias.

  • Hiring cheat sheets tied to competencies guide interview panels and reduce individual bias.

  • Performance reviews are high-risk areas for bias due to confirmation bias and the halo/horn effect.

  • Requiring three pieces of evidence for each feedback item reduces unsubstantiated biased comments.

  • Managers auditing peer feedback enables identification and mitigation of bias during reviews.

  • Evidence-based performance review workshops empowered teams to discuss and call out bias openly.

  • Scaling equity efforts requires integrating objective criteria into organizational processes, not just discussions.

Notable Quotes

"We were literally doing the most and having no impact."

"When we focused on objective measurements, it really highlighted the inequity and moving the goalpost based on who it was applying."

"Scale is about doing less while having greater impact."

"We wanted to move from I know, which is subjective, to I can, which can be demonstrated."

"If a candidate meets the three non-negotiables, it’s a reason to move them forward no matter what."

"Performance reviews are petri dishes for bias, especially confirmation bias and halo/horn effects."

"Give three pieces of evidence for every piece of feedback you provide an individual."

"Managers need to audit the feedback their team receives, not just accept it at face value."

"We asked people to judge others’ feedback with an anti-bias lens instead of focusing on their own biases."

"Let the bird fly of hearts and minds. Don’t go chasing waterfalls; disrupt your organization with checklists."

Ask the Rosenbot
Erika Flowers
AI-Readiness: Preparing NASA for a Data-Driven, Agile Future
2025 • Designing with AI 2025
Gold
Dan Mall
“Ask Me Anything” with Dan Mall, Author of Upcoming Rosenfeld Title, Design that Scales
2023 • DesignOps Summit 2023
Gold
Louis Rosenfeld
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Tamara Hale
War Stories LIVE! Tamara Hale
2020 • Advancing Research 2020
Gold
Edgar Anzaldua Moreno
Using Research to Determine Unique Value Proposition
2021 • Advancing Research 2021
Gold
Indra Klavins
A Design Ops Girl in a Dev Ops World
2019 • DesignOps Summit 2019
Gold
Amy Parness
Scaling Sustainability: Complementary strategies that drive long-term success
2025 • Climate UX Interest Group
Lily Aduana
5 Reasons to Bring Your Recruiting in-House (and How To Do It)
2021 • Advancing Research 2021
Gold
Jemma Ahmed
Redefining the research toolkit: Expanding methodologies for a changing world
2025 • Advancing Research 2025
Gold
Tess Dixon
C'mon Get Happy
2021 • DesignOps Summit 2021
Gold
Rebecca Topps
Planning and conducting remote usability studies for accessibility
2020 • Advancing Research Community
Scott Jensen
Short Take #2: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
John Mortimer
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Louis Rosenfeld
GenAI for UXers: A Rosenbot Demo and Discussion
2025 • DesignOps Summit 2025
Gold
Uday Gajendar
Theme One Intro
2023 • Enterprise UX 2023
Gold
Paul Pangaro, PhD
Systems Disciplines: Table Stakes for 21st Century Organizations
2023 • Enterprise UX 2023
Gold

More Videos

Jim Kalbach

"Jazz soloists draw from a lifetime of patterns, sometimes quoting TV theme songs like the Muppets or Sanford and Son."

Jim Kalbach

Jazz Improvisation as a Model for Team Collaboration

November 6, 2017

Louis Rosenfeld

"Evergreen content needs a strong perspective on why the topic matters along with practical examples on how to apply it."

Louis Rosenfeld

Coffee with Lou: Should You Write a (UX) Book?

March 7, 2024

Catt Small

"If you’re sitting there thinking I need to build out this project and nobody else is saying the same thing, it means you have to do it, period."

Catt Small Micah Bennett Brian Carr Jessica Harllee

What's Next for ICs: Exploring Staff and Principal Designer Roles

February 22, 2024

Marieke McCloskey

"I invited Mark to a user interview — he had no idea interviewing wasn’t for him but respected that skill deeply."

Marieke McCloskey

User Science: Product Analytics & User Research

March 11, 2021

Llewyn Paine

"Processing limits and licensing terms currently restrict how much video and audio these AI tools can handle."

Llewyn Paine

[Demo] Deploying AI doppelgangers to de-identify user research recordings

June 5, 2024

Joshua Noble

"Synthetic controls create counterfactuals using historical data when no suitable control group exists."

Joshua Noble

Casual Inference

October 6, 2023

Sara Logel

"We need to think about who we’re sharing with, how they might react, and what motivates them."

Sara Logel

Your Colleagues are Your Users Too

March 29, 2023

Bria Alexander

"The themes this year include transforming century-old industries, startup to enterprise, the outsider’s perspective, and partnering to transform."

Bria Alexander Louis Rosenfeld

Welcome

January 8, 2024

Sam Proulx

"Frequent, bite-sized training is crucial so staff actually remember how to support customers with disabilities."

Sam Proulx

Online Shopping: Designing an Accessible Experience

June 7, 2023