Rosenverse
Creating More Bias-Proof Designs

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Creating More Bias-Proof Designs

Wednesday, January 22, 2025 • Rosenfeld Community
Share the love for this talk
Creating More Bias-Proof Designs
Speakers: Sandra Camacho
Link:

Summary

What's one thing that prevents our designs from truly serving and uplifting as many users as possible? Implicit bias. While design has the power to drive positive change in the world, it's much more likely to uphold oppressive systems (such as racism, ableism, sexism and classism). This leads to harmful and exclusionary user experiences that fail to deliver on design's promises of usability, delight, relevance and accessibility. In this session, Sandra explores how implicit bias shows up in our designs by examining real-world examples across various design disciplines, including graphic design, UX, service design and product design. She then reviews practical techniques you can apply to start to root out bias from your designs, including: Evaluating designs for patterns of implicit bias (such as racial bias, gender bias, language bias and beyond) Interrogating the root causes of these biases across the design process Addressing bias both preventively (before it happens) and reactively (after it happens)

Key Insights

  • Bias in design is often systemic and tied to societal power structures, not just individual unconscious tendencies.

  • Algorithmic bias in technology can reproduce harmful societal preferences, such as privileging lighter skin tones in image recognition.

  • Design defaults frequently center dominant identity groups, resulting in exclusion of marginalized users, like right-handed bias in classrooms or cisgender assumptions in signup flows.

  • Intersectionality is crucial to understanding how multiple social identities interact with bias and privilege in design outcomes.

  • Surface-level fixes do not address the root causes of bias; systemic cultural change within teams and organizations is needed.

  • Developing reflexivity—recognizing one’s own identity and power—in designers is key to surfacing implicit bias early in the process.

  • Accountability means owning responsibility for discriminatory design outcomes regardless of intent and closing the gap between intention and impact.

  • Tools and practices such as personas, user research, and testing often embed bias if not critically examined for inclusivity.

  • Bias exists on a spectrum between oppressive and liberatory design, not a simple binary of biased or unbiased.

  • Community building and ongoing collective learning play an important role in fostering inclusive and equitable design practices.

Notable Quotes

"If you’re in tech, you are in social change, whether you realize it or not."

"Bias is a particular tendency, feeling or opinion in favor or against something, usually without reason or evidence."

"The Twitter algorithm favored the person with lighter skin tone as the most important part of the photo."

"White supremacy is the belief system of the superiority of whiteness embedded in systems, including algorithms."

"Systemic bias means a tendency for procedures and practices within an institution that favors certain social groups over others."

"The world isn’t designed for left-handed people, but left-handedness doesn’t have the same power structure implications as race or gender."

"Designers need to reflect on who their default user is and how power influences what is prioritized."

"Changing a biased design isn’t just changing features—it requires changing the entire design process and culture."

"There is often a gap between intentions and impact in design, and accountability closes that gap."

"Bias shows up overtly and covertly; sometimes it’s socially accepted or unnoticed, but still causes harm."

Ask the Rosenbot
Jess Greco
Creating a Basis for Change: Scaling Design Maturity
2022 • Design at Scale 2022
Gold
Emily Eagle
Can't Rewind: Radio and Retail
2019 • Enterprise Experience 2019
Gold
Mark Interrante
Collaboration Flows in Product Development
2017 • Enterprise Experience 2017
Gold
Joerg Beringer
Scaling User Research with AI: Continuous Discovery of User Needs in Minutes
2025 • Designing with AI 2025
Gold
Catt Small
What's Next for ICs: Exploring Staff and Principal Designer Roles
2024 • Rosenfeld Community
Brian T. O’Neill
Does Designing and Researching Data Products Powered by ML/AI and Analytics Call for New UX Methods?
2022 • QuantQual Interest Group
Jennifer Strickland
Fireside Chat: How Design Addresses a World on Fire
2022 • Civic Design Community
Charlotte Lee
Theme 1 Intro
2021 • Civic Design 2021
Gold
Robert Reimann
Taming Design Complexity with UX Models
2017 • Enterprise Experience 2017
Gold
Bria Alexander
OKRs—Helpful or Harmful?
2022 • DesignOps Community
Laura Klein
Unique challenges of innovation in enterprises
2020 • Enterprise Community
Phil Gilbert
A Consistent Culture of Design
2015 • Enterprise UX 2015
Gold
Jerome “Axle” Brown
How to Use Self-Directed Learning to Ensure Your Research Insights are Heard and Acted Upon
2021 • Advancing Research 2021
Gold
Sam Proulx
Prototype Reviews, People With Disabilities, and You
2021 • Civic Design 2021
Gold
Lija Hogan
Practical Principles of Inclusive Research
2023 • Advancing Research 2023
Gold
Gina Mendolia
Therapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems
2024 • Advancing Service Design 2024
Gold

More Videos

Alexia Cohen

"We actively reduced jargon to make our process accessible for non-designers."

Alexia Cohen Adriane Ackerman

Increasing Health Equity and Improving the Service Experience for Under-Served Latine Communities in Arizona

December 4, 2024

Marc Majers

"We typically design for the perfect path. Do you design and plan and test for the unexpected path?"

Marc Majers Tony Turner

Interrupted UX - Add A Dose of Reality To Usability Testing

March 11, 2022

Jorge Arango

"Design thinking has helped raise awareness but often lacks the depth of design practice which requires dedicated craft."

Jorge Arango

Design as an Antidote to VUCA

May 9, 2019

Brenna Fallon

"It matters what you build, but it matters more if you learn."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Daniel Gloyd

"We as humans value warmth information in others more than competence information."

Daniel Gloyd

Warming the User Experience: Lessons from America's first and most radical human-centered designers

May 9, 2024

Sam Proulx

"The four Cs—consistency, convenience, confidence, and customizability—are not just good for accessibility, they make a great experience for everyone."

Sam Proulx

Online Shopping: Designing an Accessible Experience

October 3, 2023

Kristin Skinner

"The future of education lies in collaboration and adaptation."

Kristin Skinner

Five Years of DesignOps

September 29, 2021

Denise Jacobs

"I appreciate your allyship when I'm in the room, but I appreciate it more when I'm not in the room."

Denise Jacobs Nancy Douyon Renee Reid Lisa Welchman

Interactive Keynote: Social Change by Design

January 8, 2024

Roberta Dombrowski

"Fraud detection automatically refunds you if a participant is found to be fraudulent and helps find a replacement."

Roberta Dombrowski Lianna Aduana

5 Reasons to Bring your Recruiting in House

September 30, 2021