[Demo] Complexity in disguise: Crafting experiences for generative AI features

Key Insights

• •

  Building specialized AI features requires predefining most of the prompt to guide the LLM effectively rather than having users write their own prompts.

• •

  Users refine prompts iteratively in chat interfaces, but specialized tools often allow only one shot with limited input variables.

• •

  Understanding the backend prompt structure is critical for designers to decide which parts are fixed and which are configurable by users.

• •

  Tone of voice is a complex variable that significantly impacts product description differentiation and brand personality.

• •

  Free-text inputs for tone proved difficult for users; predefined tone options simplify user choices while maintaining quality.

• •

  AI models inconsistently detect tone from existing text samples and report high confidence in contradictory results, making this approach unreliable.

• •

  Successful tone options must be sufficiently distinct to allow users to easily identify and select the best fit for their brand.

• •

  Embedding detailed tone attribute descriptions (e.g., vocabulary, pronouns, punctuation) in prompts improves AI output quality.

• •

  The default confident and positive tone of models like ChatGPT may not suit all contexts and needs to be explicitly adjusted in prompts.

• •

  Providing a minimal, intuitive UI that maps to rich, complex backend instructions balances user simplicity with output quality.

Notable Quotes