Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Summary
Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.
Key Insights
-
•
Concept testing is crucial before product development to validate market need but is underutilized in UX research.
-
•
Three types of concept testing address different questions: what a product does, why users should care, and how to communicate benefits.
-
•
Monadic, sequential, and trade-off testing methods offer varying cost, complexity, and discrimination power trade-offs.
-
•
Trade-off techniques like MaxDiff and conjoint analysis provide stronger discrimination and work well across cultures.
-
•
Combining qualitative research before and after quantitative concept testing improves hypothesis formulation and insights interpretation.
-
•
Including pricing in concept tests impacts user responses and business decisions significantly.
-
•
Brand presence in tests alters multiple metrics, requiring strategic decisions on branded vs. blind studies.
-
•
Online scrappy tests like A/B experiments capture behavior but lack insight into motivations and messaging impact.
-
•
Concept testing helps bridge the gap between UX discovery and business outcomes, strengthening business cases for UX research.
-
•
Expertise is needed to design and analyze complex trade-off tests; partnering with specialized researchers can maximize value.
Notable Quotes
"Concept testing is about testing ideas before development to confirm there is a real need for the product."
"UX researchers tend to focus on the experience after features are approved, missing the chance to validate earlier."
"People care not about product features but what these features do for them."
"Showing several concepts side by side and forcing choices yields better discrimination than rating scales."
"Qualitative research is excellent for discovering needs but poor at quantifying their scale or priority."
"If you have limited resources, start with a simple monadic test using low-cost survey tools."
"MaxDiff is great for prioritizing feature backlogs, especially when you have long lists to evaluate."
"Testing price effects requires careful design because user behavior can be irrational when prices are shown or hidden."
"No research method is perfect; use a mix and triangulate results depending on whether you want to predict or explain."
"When you start concept testing, be clear about what parts of the concept describe the what, the why, and the how."
Or choose a question:
More Videos
"Google Docs is not a web page; it’s a web app that requires handling many keyboard shortcuts and focus management."
Sam ProulxEverything You Ever Wanted to Know About Screen Readers
June 11, 2021
"If you want to avoid time zone confusion, you can switch the conference schedule to your local time on the program page."
Bria AlexanderOpening Remarks
November 17, 2022
"You do not have to go publicly thank the employer who just laid you off. They’ll be fine without it."
Corey Nelson Amy SanteeLayoffs
November 15, 2022
"Experience is one of three inseparable facets of an enterprise: identity (purpose), architecture (operations), and experience (value to people)."
Milan GuentherA Shared Language for Co-Creating Ambitious Endeavours
June 6, 2023
"People will talk to customers whether you want them to or not. The question is how to make it a better experience."
Erin May Roberta Dombrowski Laura Oxenfeld Brooke HintonDistributed, Democratized, Decentralized: Finding a Research Model to Support Your Org
March 10, 2022
"Simulation or personas can never replace testing with real users to build empathy and get accurate results."
Sam ProulxUnderstanding Screen Readers on Mobile: How And Why to Learn from Native Users
June 6, 2023
"Adding a senior researcher, Izzy, in field meant we could have more, smaller research tracks and better support for research newbies."
Mujtaba HameedThe new horizon of ethnography: using AI to unlock the full potential of in-person research
March 11, 2026
"Futures thinking is not about predicting the future, but about being smarter about anticipating risks and consequences of our actions today."
Ilana LipsettAnticipating Risk, Regulating Tech: A Playbook for Ethical Technology Governance
December 10, 2021
"One in four people in the United States have a disability."
Samuel ProulxFrom Standards to Innovation: Why Inclusive Design Wins
September 10, 2025
