Rosenverse
SUS: A System Unusable for Twenty Percent of the Population

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population

Gold
Wednesday, June 9, 2021 • Design at Scale 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right! People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. When the SUS was invented, the author encouraged people to change it to suit different needs. In this talk, Samuel Proulx and Abid Virani from Fable will discuss how Fable adapted the SUS to work for assistive technology users. Drawing from over five thousand hours of research and testing involving assistive technology users, we created the Accessible Usability Scale (AUS). This presentation will include trends in AUS responses since it was released in December of 2020.

Key Insights

  • •

    Assistive technologies mainly split into screen readers, screen magnifiers, and alternative navigation devices, each with distinct user needs.

  • •

    Screen reader users heavily rely on semantic web structure and proper labeling for efficient navigation.

  • •

    Magnification users often supplement their experience with screen reader features to reduce eye strain.

  • •

    Alternative navigation users use multiple input methods like voice commands and head mice, providing fallback options.

  • •

    Traditional usability labs and standard SUS questionnaires fail to consider unique accessibility challenges and setup of assistive tech users.

  • •

    SUS questions like needing technical support or learning speed are confusing or irrelevant to assistive tech users without adaptation.

  • •

    Fable created the Accessible Usability Scale to better evaluate assistive tech user experience by adapting question language and scope.

  • •

    Preliminary AUS data indicates screen reader users experience the lowest usability scores due to lack of backup input methods.

  • •

    Remote usability testing greatly increases participation and authentic results by allowing users to test in familiar, customized environments.

  • •

    User skill with assistive tech, experience level, and mental models vary significantly and must be considered beyond linear novice-expert scales.

Notable Quotes

"Assistive technology includes software and hardware that people with disabilities use to access computers."

"Screen readers let us jump directly to content, replicating visual skimming of a web page."

"Expert screen reader users listen at over 300 words per minute and still fully understand the content."

"Magnification can cover the entire screen two to ten times, and users pan around to see different areas."

"Many magnification tools also have screen reader functions to reduce eye strain and help users."

"Alternative navigation users might use voice commands, head mice, or grid coordinates to access elements."

"Traditional usability labs often force assistive tech users to use unfamiliar setups, creating barriers."

"I am a technical person, yet I might still need someone who can see to help me use certain sites."

"Accessibility is a spectrum; if frequent tasks require assistance, the product is inaccessible for me."

"Remote testing helps get closer to real-world results because users are in environments customized for them."

Ask the Rosenbot
Dan Willis
Enterprise Storytelling Sessions
2019 • Enterprise Experience 2019
Gold
Victor Udoewa
Beyond Methods and Diversity: The Roots of Inclusion
2024 • Advancing Research 2024
Gold
Vincent Brathwaite
Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams
2020 • DesignOps Summit 2020
Gold
Kit Unger
Theme 3 Intro
2022 • Design at Scale 2022
Gold
Dave Malouf
Panel: Design Systems and Documentation
2017 • DesignOps Summit 2017
Gold
Llewyn Paine
Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
2025 • Advancing Research 2025
Gold
Rima Campbell
Increase Productivity and Drive Business Impact
2024 • DesignOps Summit 2024
Gold
Brigette Metzler
Scaling ResearchOps: Helping Researchers do Their Best Work
2020 • Advancing Research 2020
Gold
Savina Hawkins
Harnessing AI in UXR: Practical Strategies for Positive Impact
2024 • Advancing Research 2024
Gold
Peter Van Dijck
Building impactful AI products for design and product leaders, Part 3: Understand AI architectures: RAG, Agents, Oh My!
2025 • Rosenfeld Community
Ariba Jahan
Team Resiliency Through a Pandemic
2024 • DesignOps Summit 2020
Gold
Jim Kalbach
Peace is waged with sticky notes: Mapping Real-World Experiences
2018 • Enterprise Experience 2018
Gold
Brian Moss
What Does it Mean to be a Resilient Research Team?
2022 • Advancing Research 2022
Gold
Dr. Karl Jeffries
The Science of Creativity for DesignOps
2024 • DesignOps Summit 2020
Gold
John Donmoyer
Shipping your code generation experiments to production
2025 • Designing with AI 2025
Gold
Chloe Amos-Edkins
A Cultural Approach: Research in the Context of Glocalisation
2023 • Advancing Research 2023
Gold

More Videos

Marc Fonteijn

"Half of the service design professionals do not feel connected to their peers, which is significant."

Marc Fonteijn Ru Butler

Increase your confidence, influence, and impact (through a Professional Community)

December 3, 2024

Dem Gerolemou

"Asking stupid questions can lead experts to reframe their thinking and improve the work."

Dem Gerolemou Alexis Oh Neef Rehman

Climate technology fundamentals

May 15, 2024

Daniela Magaña Flores

"Users tend to rate a familiar site better than non-users, especially for Amazon, because they feel more secure and familiar."

Daniela Magaña Flores Ariane Rahn Jeff Ephraim Bander

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

March 10, 2022

Abbey Smalley

"Design systems are not just components but guidelines, rules, and principles to create consistent experiences."

Abbey Smalley Sylas Souza

Scaling UX Past the Size of Your Team

January 8, 2024

Patrick Commarford

"Before transitioning designers, we reviewed and agreed on a prioritized list with all executive leaders."

Patrick Commarford

Design Staffing for Impact

January 8, 2024

Xenia Adjoubei

"We were interested in supporting networks of self-organization and mutual aid formed between refugees and host communities."

Xenia Adjoubei Sean Bruce

Empowering Communities Through the Researcher in Residence Program

March 29, 2023

Craig Villamor

"Under a system which promotes growth at all cost and views engagement of time and data as monetary gain, digital products converge as they all race to employ the design patterns that generate the fattest bottom line."

Craig Villamor

Design Systems for Ethical Design

January 26, 2023

Jon Fukuda

"We don’t need a north star, we need a constellation that allows us to see the full picture."

Jon Fukuda Ellie Krysl

Design Planning and Management Support

October 3, 2023

Iain McMaster

"31% say design just executes product’s vision, 48% say product and design have different visions, only 21% say they work together towards shared goals."

Iain McMaster IHan Cheng

Design and Product: from Frenemy to Harmony

November 29, 2023