Does Designing and Researching Data Products Powered by ML/AI and Analytics Call for New UX Methods?

Key Insights

• •

  UX researchers in ML-heavy environments often face steep domain knowledge gaps requiring strong interview facilitation to bridge communication.

• •

  Designing for AI data products demands a shift from generic user interfaces to tools tailored for expert users who need explainability over polish.

• •

  Cross-functional collaboration thrives by creating shared spaces that respect differing expertise while focusing on a unifying product goal.

• •

  Decision culture focusing on how decisions are made is more useful than a vague data culture mindset when designing AI/ML products.

• •

  Besides customers and stakeholders, data labelers who curate training data form a critical, often overlooked human part of the ML ecosystem.

• •

  Model interpretability can be more important than raw accuracy because users must trust a system to adopt it and generate value.

• •

  Prototyping data products requires believable data and can be facilitated by testing edge cases like false positives and trust thresholds early.

• •

  Incremental learning loops involving user feedback can improve models over time and should be designed into AI products.

• •

  Contextualizing data model outputs with business rules and user environment (e.g., seasonal factors) increases relevance and trust.

• •

  No-code data science tools and scenario building help teams quickly experiment with data products despite the usual slow model training cycles.

Notable Quotes