Rosenverse
Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

Gold
Thursday, March 10, 2022 • Advancing Research 2022
Share the love for this talk
Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
Speakers: Daniela Magaña Flores , Ariane Rahn and Jeff Ephraim Bander
Link:

Summary

In our session we will deal with efficient and fast possibilities of UX measurement. Does the web presence or app look attractive and inspiring to new and established users? What are the strengths and weaknesses compared to the competition? We will present insights from our UX Online Benchmarking, which show that the implicit first impression is decisive. Get first insights about the eCommerce, insurance, and travel industries!

Key Insights

  • •

    ISQUER's UX benchmarking combines explicit (questionnaire-based) and implicit (reaction-time based) methods for a comprehensive user experience evaluation.

  • •

    Implicit measurement captures 50% of the unconscious factors influencing purchase decisions, emphasizing the importance of gut feelings in UX.

  • •

    Reaction time combined with agreement/disagreement responses in the Product React tool quantifies users' immediate, intuitive attitudes toward product attributes.

  • •

    Users typically rate a product's usability and trustworthiness higher than non-users, reflecting familiarity and built relationships.

  • •

    Net Promoter Scores vary drastically between users and non-users, indicating differing loyalties and perceptions within the same product.

  • •

    Mobile users often rate Net Promoter Scores higher than desktop users, suggesting better mobile experiences for some ecommerce sites like Amazon.

  • •

    ISQUER’s benchmarking surveys allow free product exploration for 3 minutes, enabling authentic interaction without restricting users to homepages only.

  • •

    Home 24 scored highest in appeal and inspiration due to a streamlined, well-structured website design, unlike Amazon or eBay’s more cluttered pages.

  • •

    Repeated benchmarking before and after product changes provides actionable insights to measure optimization effects over time.

  • •

    ISQUER’s extensive database and 23 years of experience with implicit methods lend reliability and depth to benchmarking results.

Notable Quotes

"We offer a quantitative approach so you can quickly recognize the strengths and weaknesses in a product compared to competitors."

"We use a holistic methodological approach combining explicit and implicit quantitative methods to fully get the user's perspective."

"The first impression is crucial as it triggers excessive unconscious processes that influence preferences."

"Implicit methods alone can explain around 80% of the purchase decision, with half of it due to unconscious measurements."

"The faster the reaction, the less distorted it is by cognitive processes, capturing genuine gut feelings."

"Users tend to rate a familiar site better than non-users, especially for Amazon, because they feel more secure and familiar."

"Our benchmarking survey includes free exploration of the entire website or app, not just the homepage."

"Mobile users gave Amazon a higher Net Promoter Score than desktop users, indicating a better mobile experience."

"Home 24’s website is not cluttered and well-structured, explaining its higher appeal and inspiration scores."

"Doing at least two benchmarking rounds lets you see if optimizations have measurable impacts over time."

Ask the Rosenbot
Laine Riley Prokay
How DesignOps can Drive Inclusive Career Ladders for All
2021 • DesignOps Summit 2021
Gold
Carol Massa
Designing Health: Integrating Service Design, Technology, and Strategy to Transform Patient and Clinician Experiences
2024 • Advancing Service Design 2024
Gold
Bria Alexander
Day 1 Panel: Up to the Minute: The latest in AI’s impact on UX
2025 • Designing with AI 2025
Gold
Saara Kamppari-Miller
Inclusive Design is DesignOps
2021 • DesignOps Summit 2021
Gold
Caitlyn Hampton
Compass 101: Growing Your Career In A Startup World
2021 • Design at Scale 2021
Gold
James Chudley
Decarbonising User Journeys: How minimising enables us to do more with less
2025 • Climate UX Interest Group
Sara Conklin
A UXer’s 12-Month Journey from Climate Concern to Climate Credibility
2025 • Climate UX Interest Group
Tala Tayebi
Voice and influence in an age of noise
2026 • Advancing Research 2026
Gold
Robert Fabricant
Industry junctures: Paths forwards for UXR and the critical decisions that get us there [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Paula Bach
Improving Legacy Software: How Much Better Does it Have to Be?
2022 • Advancing Research 2022
Gold
Jennifer Kong
Journeying toward AI-assisted documentation in healthcare
2024 • Designing with AI 2024
Gold
Gonzalo Goyanes
Design ROI: Cover a Little, Get a Lot
2022 • DesignOps Summit 2022
Gold
Mariah Hay
Ethics in Tech Education: Designing to Provide Opportunity for All
2018 • Enterprise Experience 2018
Gold
Lori Muszynski
Keeping Design Weird
2023 • DesignOps Summit 2023
Gold
Tiffany Cheng
Designing in a Pandemic: Integrating Speed and Rigor
2022 • Design at Scale 2022
Gold
Bud Caddell
DesignOps Community Sensing Session
2021 • DesignOps Community

More Videos

Mark Interrante

"Nobody’s gonna listen to you people until you start speaking in the language of business."

Mark Interrante Harry Max

AI for Prioritization (3rd of 3 seminars)

July 11, 2024

Patrizia Bertini

"The more the compliance level increased, the higher the cost efficiency."

Patrizia Bertini

The (r)evolution of designOps: It’s Time to Think (really) BIG

September 11, 2025

Shan Shen

"A tree test focuses on intuitive navigation while a prototype aims for the desired modality of an end solution."

Shan Shen

Translating UX Terms into Business Contexts

November 29, 2023

Adam Thomas

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

Adam Thomas

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

December 6, 2022

Robin Beers

"Experiential significance is that moment in research when something just hits you as really important and impossible to ignore."

Robin Beers

Research as a Catalyst for Organizational Transformation

March 12, 2021

Sheri Byrne-Haber

"Accessibility isn’t just about visible disabilities; it’s about invisible disabilities and situational impairments too."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Joseph Meersman

"Critiques help teams stop being the lone ranger and instead iterate faster together with purpose and clarity."

Joseph Meersman

Sweating the Pixel: Scaling Quality through Critique

June 10, 2021

Deanna Washington

"I’m still early on in measuring accessibility impact but tying early bug fixes to ROI is promising."

Deanna Washington Bria Alexander Jon Fukuda Saara Kamppari-Miller Farid Sabitov

Connecting the Ops: Plenary Panel and Closing Circle

September 9, 2022

Aaron Stienstra

"We have the responsibility to redistribute our power and include those who have a stake in the work we do."

Aaron Stienstra Lashanda Hodge

Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government

December 8, 2021