Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Summary
Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.
Key Insights
-
•
Concept testing is crucial before product development to validate market need but is underutilized in UX research.
-
•
Three types of concept testing address different questions: what a product does, why users should care, and how to communicate benefits.
-
•
Monadic, sequential, and trade-off testing methods offer varying cost, complexity, and discrimination power trade-offs.
-
•
Trade-off techniques like MaxDiff and conjoint analysis provide stronger discrimination and work well across cultures.
-
•
Combining qualitative research before and after quantitative concept testing improves hypothesis formulation and insights interpretation.
-
•
Including pricing in concept tests impacts user responses and business decisions significantly.
-
•
Brand presence in tests alters multiple metrics, requiring strategic decisions on branded vs. blind studies.
-
•
Online scrappy tests like A/B experiments capture behavior but lack insight into motivations and messaging impact.
-
•
Concept testing helps bridge the gap between UX discovery and business outcomes, strengthening business cases for UX research.
-
•
Expertise is needed to design and analyze complex trade-off tests; partnering with specialized researchers can maximize value.
Notable Quotes
"Concept testing is about testing ideas before development to confirm there is a real need for the product."
"UX researchers tend to focus on the experience after features are approved, missing the chance to validate earlier."
"People care not about product features but what these features do for them."
"Showing several concepts side by side and forcing choices yields better discrimination than rating scales."
"Qualitative research is excellent for discovering needs but poor at quantifying their scale or priority."
"If you have limited resources, start with a simple monadic test using low-cost survey tools."
"MaxDiff is great for prioritizing feature backlogs, especially when you have long lists to evaluate."
"Testing price effects requires careful design because user behavior can be irrational when prices are shown or hidden."
"No research method is perfect; use a mix and triangulate results depending on whether you want to predict or explain."
"When you start concept testing, be clear about what parts of the concept describe the what, the why, and the how."
Or choose a question:
More Videos
"Getting something accessible is a straight line; keeping something accessible requires process change."
Sheri Byrne-HaberAccessibility at Scale
June 9, 2021
"Observation reveals needs users themselves haven’t recognized yet."
Prayag Narula Hannah HudsonEmpowering Designers to do Good Research
March 11, 2022
"Companies had to relearn their customers during COVID because behavior had fundamentally changed."
Janelle EstesUX Research Trends
January 28, 2021
"Start with content first wireframing and avoid lorem ipsum to prevent treating words like decoration."
Craig Brookes Andreas Huebner Morgan Quinn"Just Make it Look Good" and Other Ways We're Misunderstood
June 11, 2021
"High quality personal connections mean you can engage on a level playing field with serious professionals."
Marc Fonteijn Ru ButlerIncrease your confidence, influence, and impact (through a Professional Community)
December 3, 2024
"Research ops provides the roles, tools, and processes needed to support researchers — that’s as concise as it gets."
Kate TowseyThe State of ResearchOps: More Than Just Theory
June 20, 2019
"Sometimes the entire leadership team quitting at once is a big sign cultural safety is failing."
Alla WeinbergDesign Teams Need Psychological Safety: Here’s How to Create It
September 9, 2022
"A government designer aims to reduce UX variation while a contractor may optimize only their single product, creating potential conflicts."
Shawna Hein Kevin HoffmanCreate a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts
November 17, 2022
"Designing for marginalized communities often shows how to build scalable solutions with limited resources, saving money."
Tricia WangSCALE: Discussion
June 15, 2018
Latest Books All books
Dig deeper with the Rosenbot
How do I handle credibility challenges and emotional barriers when working with medical professionals?
How should I choose communication channels and message formats to effectively share research insights?
How could universal acceptance and personalized learning journeys change college admissions and education?