It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
Summary
While usability testing is an often overlooked part of design in the frenzied race to get technology to market, it’s absence is especially problematic when it comes to civic-focused products and services. Even when designers want to test, options are often limited to "professional testers" or personal networks - far from the actual users they’re hoping to help. Testing with a diverse group of end users and stakeholders is the only surefire way to make sure what gets designed works for everyone, but the approach needs to be thoughtful, sensitive and impactful. Since launching in early 2019, GRIT has delivered more than 20 such inclusive usability testing engagements with partners in the public, private and nonprofit sectors and we’re eager to share our insights with others who endeavor to engage diverse, underrepresented communities in the design of their civic products and services. Using case studies and lessons from our trove of civic design engagements, we'll help take the guesswork out of inclusively testing your next design.
Key Insights
-
•
Inclusive usability testing uncovers user needs that would otherwise be missed, especially for vulnerable populations.
-
•
Building a diverse participant pool requires going offline to meet people in their everyday community spaces, not just digital recruitment.
-
•
Offering flexible testing times beyond standard working hours increases participation from diverse socioeconomic backgrounds.
-
•
Creating a comfortable, informal testing environment with snacks and a non-intimidating setting improves honest feedback.
-
•
Clear, jargon-free communication and early sharing of consent forms build trust and reduce participant anxiety.
-
•
Maintaining a single point of contact for participants prevents confusion and fosters smoother coordination.
-
•
Compensation at a rate of $1 to $1.25 per minute, reimbursed travel, and prompt payments boost recruitment speed and retention.
-
•
Referrals from satisfied testers can help reach specific demographics and expand testing pools efficiently.
-
•
Longitudinal testing, involving participants multiple times, enhances insights as the product evolves.
-
•
Testing with real users who rely on assistive technologies, like screen readers or voice commands, validates accessibility effectively.
Notable Quotes
"If it doesn’t work for you, it doesn’t work."
"When you test inclusively, you’re learning about the people who will be directly impacted by your work, your users."
"Technology that includes everyone, especially those from vulnerable populations, ensures that what gets built will work for everyone."
"Participant experience is everything and it starts with building trust."
"No surprises. Tell participants everything they’ll be experiencing from who will be in the room to if the session will be recorded."
"Use plain language in all communication. No design or technology jargon."
"Build your pool, build your practice. If you provide a great testing experience, you’ve got another person to add to your group."
"Compensation is so important to thank people for their time, and you will definitely build your recruitment pool much faster if you offer it."
"We intentionally did not email listservs or go on Twitter because that would have delivered a group that is too tech-savvy."
"During testing sensitive subjects, have relevant resources at the ready, like shelter beds for participants in need."
Or choose a question:
More Videos
"Accessibility defects are bugs. If it’s a P1 blocking bug for an accessibility issue, treat it like any other P1 bug."
Sheri Byrne-HaberAccessibility at Scale
June 9, 2021
"If you skip iterative testing, you risk building features nobody really wants."
Prayag Narula Hannah HudsonEmpowering Designers to do Good Research
March 11, 2022
"Centralized teams can become 'no machines' when overwhelmed with requests, needing to prioritize carefully."
Janelle EstesUX Research Trends
January 28, 2021
"Content design is nascent and often misunderstood, but embedding content designers improves product clarity and usability."
Craig Brookes Andreas Huebner Morgan Quinn"Just Make it Look Good" and Other Ways We're Misunderstood
June 11, 2021
"A regular heartbeat and familiar structure are really important principles to keep a community alive."
Marc Fonteijn Ru ButlerIncrease your confidence, influence, and impact (through a Professional Community)
December 3, 2024
"The longer you take to recognize research ops and scale your team, the harder it becomes to amplify the value of your research investment — Carrie, Booking.com."
Kate TowseyThe State of ResearchOps: More Than Just Theory
June 20, 2019
"When we’re not safe, our thinking brain — the neocortex — shuts down and operating IQ drops by half."
Alla WeinbergDesign Teams Need Psychological Safety: Here’s How to Create It
September 9, 2022
"Our digital experience group acts like hosts and planners making sure veterans sit down to a cohesive, inclusive meal, not just disparate dishes."
Shawna Hein Kevin HoffmanCreate a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts
November 17, 2022
"Every culture has things to celebrate and improve upon; we should learn from others instead of imposing our own standards."
Tricia WangSCALE: Discussion
June 15, 2018
