Rosenverse
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

Gold
Thursday, December 9, 2021 • Civic Design 2021
Share the love for this talk
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
Speakers: Marisa Bernstein
Link:

Summary

While usability testing is an often overlooked part of design in the frenzied race to get technology to market, it’s absence is especially problematic when it comes to civic-focused products and services. Even when designers want to test, options are often limited to "professional testers" or personal networks - far from the actual users they’re hoping to help. Testing with a diverse group of end users and stakeholders is the only surefire way to make sure what gets designed works for everyone, but the approach needs to be thoughtful, sensitive and impactful.

Since launching in early 2019, GRIT has delivered more than 20 such inclusive usability testing engagements with partners in the public, private and nonprofit sectors and we’re eager to share our insights with others who endeavor to engage diverse, underrepresented communities in the design of their civic products and services. Using case studies and lessons from our trove of civic design engagements, we'll help take the guesswork out of inclusively testing your next design.

Key Insights

  • •

    Inclusive usability testing uncovers user needs that would otherwise be missed, especially for vulnerable populations.

  • •

    Building a diverse participant pool requires going offline to meet people in their everyday community spaces, not just digital recruitment.

  • •

    Offering flexible testing times beyond standard working hours increases participation from diverse socioeconomic backgrounds.

  • •

    Creating a comfortable, informal testing environment with snacks and a non-intimidating setting improves honest feedback.

  • •

    Clear, jargon-free communication and early sharing of consent forms build trust and reduce participant anxiety.

  • •

    Maintaining a single point of contact for participants prevents confusion and fosters smoother coordination.

  • •

    Compensation at a rate of $1 to $1.25 per minute, reimbursed travel, and prompt payments boost recruitment speed and retention.

  • •

    Referrals from satisfied testers can help reach specific demographics and expand testing pools efficiently.

  • •

    Longitudinal testing, involving participants multiple times, enhances insights as the product evolves.

  • •

    Testing with real users who rely on assistive technologies, like screen readers or voice commands, validates accessibility effectively.

Notable Quotes

"If it doesn’t work for you, it doesn’t work."

"When you test inclusively, you’re learning about the people who will be directly impacted by your work, your users."

"Technology that includes everyone, especially those from vulnerable populations, ensures that what gets built will work for everyone."

"Participant experience is everything and it starts with building trust."

"No surprises. Tell participants everything they’ll be experiencing from who will be in the room to if the session will be recorded."

"Use plain language in all communication. No design or technology jargon."

"Build your pool, build your practice. If you provide a great testing experience, you’ve got another person to add to your group."

"Compensation is so important to thank people for their time, and you will definitely build your recruitment pool much faster if you offer it."

"We intentionally did not email listservs or go on Twitter because that would have delivered a group that is too tech-savvy."

"During testing sensitive subjects, have relevant resources at the ready, like shelter beds for participants in need."

Ask the Rosenbot
Alissa Briggs
How to Coach Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
Louis Rosenfeld
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Melinda Belcher
Insider preview of Enterprise Experience 2020
2020 • Enterprise Community
Rachael Greene
Building a Design Ops Practice that Really Works (Most of the Time)
2025 • DesignOps Community
Andy Barraclough
From Costly Complexity to Efficient Insights: Why UX Teams Are Switching To Voxpopme
2024 • DesignOps Summit 2024
Gold
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • DesignOps Summit 2022
Gold
Alicia D. Johnson
Disasters and the 21st Century
2021 • Civic Design 2021
Gold
Kate Towsey
Shaping the future of research ops: Expanding roles and strategies for a more integrated research ecosystem
2025 • Advancing Research 2025
Gold
Aditi Ruiz
A PM State of Mind: Empathy Mapping Your Product Manager, Pt. 1
2022 • Design in Product 2022
Gold
Daniel Orbach
Zero to One: Co-Creating Operating Models with your Team
2024 • DesignOps Summit 2024
Gold
Peter Van Dijck
Designing AI-first products on top of a rapidly evolving technology
2025 • Designing with AI 2025
Gold
Ovetta Sampson
Research in the Automated Future
2022 • Advancing Research 2022
Gold
Sam Proulx
Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
2022 • DesignOps Summit 2022
Gold
Taylor Jennings
Research Debate Club
2026 • Advancing Research 2026
Gold
Kristin Sundermeyer
Design Ops Metrics
2021 • DesignOps Summit 2021
Gold
Natalie Dunbar
DesignOps and Content Strategy: Envisioning the Future Together
2021 • DesignOps Summit 2021
Gold

More Videos

Marc Fonteijn

"We design a community that would be missed if it were gone for our service design leaders."

Marc Fonteijn Ru Butler

Increase your confidence, influence, and impact (through a Professional Community)

December 3, 2024

Dem Gerolemou

"You have to make the hard thing easier to do. Behavioral change must be lower friction."

Dem Gerolemou Alexis Oh Neef Rehman

Climate technology fundamentals

May 15, 2024

Daniela Magaña Flores

"Doing at least two benchmarking rounds lets you see if optimizations have measurable impacts over time."

Daniela Magaña Flores Ariane Rahn Jeff Ephraim Bander

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

March 10, 2022

Abbey Smalley

"Target’s internal teams varied in design maturity from totally nonexistent to full design strategy, so we had to meet them where they were."

Abbey Smalley Sylas Souza

Scaling UX Past the Size of Your Team

January 8, 2024

Patrick Commarford

"We created a tiers of support model so even low priority projects get some level of guidance, even if just a 45-minute consultation."

Patrick Commarford

Design Staffing for Impact

January 8, 2024

Xenia Adjoubei

"We fundraised to cover Tatiana’s salary for three months so she could launch this project very quickly after the war started."

Xenia Adjoubei Sean Bruce

Empowering Communities Through the Researcher in Residence Program

March 29, 2023

Craig Villamor

"Dark patterns are UI designs that trick or manipulate users into doing something they wouldn't otherwise do or that go against their or society’s best interests."

Craig Villamor

Design Systems for Ethical Design

January 26, 2023

Jon Fukuda

"User research is really only part of the information schema that we’re talking about."

Jon Fukuda Ellie Krysl

Design Planning and Management Support

October 3, 2023

Iain McMaster

"Our hypothesis was we could create better product faster with more eyes looking at the problem, not just product."

Iain McMaster IHan Cheng

Design and Product: from Frenemy to Harmony

November 29, 2023