Day 2 Theme Panel
Summary
Panelists including Nadi, Amy, Katie, Ricardo, and others explored how researchers are adapting their methods to the changing dynamics between participants, researchers, and organizations. Nadi emphasized the importance of an open mind and mixed methods to uncover insights and critique tools used. Amy highlighted the need to say yes to new methods, running pilots, and staying up-to-date with emerging tools, while managing client demands. Ricardo noted that switching methods comes when existing tools can’t answer key research questions or have biases and shared inspiration from conferences. The group also discussed participatory methods, experimental designs, and the redemption of focus groups. Integrating qualitative and quantitative data and using live stories helped keep the participant experience front and center for stakeholders. Amy and others shared balancing faster, lighter studies with deeper, longer-term academic research to achieve organizational buy-in. Challenges in dealing with stakeholders who have predetermined solutions were discussed, with advice to align on shared goals and pick battles wisely to maintain research objectivity and impact. Concepts like right-sizing research (Ricardo, Nadi), systems thinking, and Lean Research principles were introduced to respect communities and strategically influence organizations. Finally, panelists recommended mentoring, community engagement, offering simple tools, and gradual experimentation to upskill researchers and colleagues new to the craft. Megan shared work on a research method playbook with a quadrant guiding new practitioners on when and how to try methods safely. The conversation underscored that research is a dynamic craft blending strategy, empathy, experimentation, and organizational navigation.
Key Insights
-
•
Switching to a new research method often occurs when current methods cannot adequately answer the research question or have inherent biases, as Ricardo explained.
-
•
A mixed-methods and cross-functional approach allows researchers to address gaps one tool alone cannot fill, advocated by Nadi.
-
•
Leaders like Amy encourage saying yes to team experimentation with novel tools and running pilots to evolve the research toolkit.
-
•
Participatory and experimental methods are gaining renewed interest, with attempts to redeem sometimes maligned methods like focus groups.
-
•
Combining qualitative data such as video and quotes with quantitative findings helps keep participant experiences vivid for stakeholders.
-
•
Right-sizing research—both in participant group size and project scope—is critical to respect community burden and project constraints, as emphasized by Ricardo and Nadi.
-
•
Balancing fast, lighter UX studies with longer academic or in-depth research enables continuous insight delivery and organizational patience for complexity, shared by Amy.
-
•
Navigating stakeholder resistance requires aligning on shared organizational goals, choosing battles carefully, and emphasizing research objectivity, as experienced by the panelists.
-
•
Lean Research principles focusing on respect, relevance, and appropriate scale offer frameworks for conducting equitable and community-sensitive research.
-
•
Upskilling less experienced researchers benefits from mentorship, community involvement, sharing simple tools and templates, and introducing safe spaces to experiment with methods.
Notable Quotes
"Tools don't matter as much as the desire to learn and ask why things keep happening the way they do."
"We say yes when teammates are curious to try new methods and run pilots to see what works and what could improve."
"When surveys measure attitude but not behavior, it's time to try methods like conjoint analysis that reduce bias."
"Focus groups have been called a curse, but I'm giving them a second chance to see if there’s something positive there."
"Combining numbers with rich participant videos and quotes really brings the user to life for stakeholders."
"Right sizing research respects communities by matching the scope to what participants can reasonably engage with."
"Slowing down research creates equitable spaces where minority and marginalized voices can be meaningfully included."
"You have to pick your battles with stakeholders—fight the ones that really matter and let smaller issues slide."
"Use systems thinking to connect insights and show how research impacts organizational strategy holistically."
"Giving someone a tool to try a method in an hour can either inspire them or clearly show it's not a fit."
Or choose a question:
More Videos
"The challenge of prioritization increases when decisions are adaptive, systemic, and dynamic."
Mark Interrante Harry MaxAI for Prioritization (3rd of 3 seminars)
July 11, 2024
"What if we are optimizing ourselves into relevance?"
Patrizia BertiniThe (r)evolution of designOps: It’s Time to Think (really) BIG
September 11, 2025
"We prioritize to code switch to clarify value and relevance using language as a tool for meaningful activities."
Shan ShenTranslating UX Terms into Business Contexts
November 29, 2023
"60 to 90% of our ideas do not improve the metrics they were intended to improve."
Adam ThomasSurvival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
December 6, 2022
"Turning the research lens on both the ‘in here’ organization and the ‘out there’ customer reality helps reveal misalignments and opportunities."
Robin BeersResearch as a Catalyst for Organizational Transformation
March 12, 2021
"You’re not supposed to sell to the US public sector unless you’re WCAG 2.0 AA compliant."
Sheri Byrne-HaberAccessibility at Scale
June 9, 2021
"Critiques maintain focus on the quality of our outcomes and sweat every pixel we put in the hands of our users."
Joseph MeersmanSweating the Pixel: Scaling Quality through Critique
June 10, 2021
"Saying no with intentionality and clear guidelines creates clarity and focus."
Deanna Washington Bria Alexander Jon Fukuda Saara Kamppari-Miller Farid SabitovConnecting the Ops: Plenary Panel and Closing Circle
September 9, 2022
"Civic designers are in a privileged position; with privilege comes the power to empower the voices of those we serve."
Aaron Stienstra Lashanda HodgeLeveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government
December 8, 2021
Latest Books All books
Dig deeper with the Rosenbot
How does Rally’s research infrastructure facilitate participant management and integration with enterprise data systems?
What are practical strategies to build influence for research insights across multiple dispersed teams?
What strategies can researchers use to become catalysts for change using play?