RisksBLACK-BOX

08

Empathy Gap

Lacks human context

AI produces output based on statistical patterns, not lived experience. It doesn't have access to the emotional, cultural, or institutional context that determines whether a design actually works.

The Synthetic Persona Fallacy names the UX-research manifestation precisely: synthetic users are too cooperative, too logical, too eager to please. Real users are contradictory, emotional, and situationally unpredictable in ways that matter. But the risk runs deeper than synthetic personas. As AI compresses cycle time between question and answer, the time practitioners spend actually being with people in their context risks shrinking proportionally. What the ethnographic tradition calls thick description, the contextual layering that makes human meaning legible, gets replaced with statistical summary. Research can be difficult and uncomfrtable, and AI gives us a very compelling reason to stay inside. But Steve Blank said it right: "Get out of the building."

Design transfer

  • Onboarding flows that don't account for user anxiety or prior failure states
  • Error states that feel robotic or blame-attributing
  • Research synthesis that loses the emotional texture of user stories
  • Service design that ignores the institutional reality of frontline workers

In the wild

Use cases

AI-moderated Interviews

EXP-007

Runs qualitative interview studies at scales not feasible with traditional human moderation, shortening fieldwork timelines while generating structured, traceable outputs ready for analysis.

Explore·Developing

Interview Question Development

EXP-003

Provides starting set of questions for researchers during study design.

Explore·Developing

Interview Thematic Coding

DEF-010

Compresses thematic coding of qualitative interview data from days to hours. Helps identify cross-participant patterns a solo researcher might miss.

Define·Developing

Journey Mapping

DEF-013

Transforms quantitative and qualitative data into a journey map faster than manual methods. Time saved on initial mapping lets teams dedicate more to filling gaps, verifying details, and socializing understanding.

Define·Emerging

Information Architecture Development

CON-082

Explore multiple organizational options for product information architecture deeply in the same time typical assisted methods spend to create one or two.

Concept·Developing

Research Previews

CON-070

Compresses time-to-learning by shipping functional builds before visual polish, enabling iteration on real user behaviour.

Concept·Developing

Scenario Generation

CON-029

Produces believable, research grounded use scenarios, allowing expert evaluation of product fit, and supporting stakeholder understanding of product direction, during concept development.

Concept·Emerging

Simulated Usability Testing

VAL-038

Agents simulate user interactions with a prototype, generating plausible behavioural data and task completion patterns without recruiting participants or scheduling sessions.

Validate·Emerging

Synthetic Stakeholder Critique

VAL-035

Gives designer access to diverse stakeholder perspectives by simulating distinct critical positions, finding unanticipated objections that can be addressed before live stakeholder engagement.

Validate·Emerging

Usability Test Analysis

VAL-032

Compresses the time from test sessions to actionable findings by automating pattern detection, theme extraction, and highlight identification within recordings and transcripts.

Validate·Developing

Validate Concept Appeal

VAL-101

Compresses concept validation from weeks to days by running AI-moderated interviews at scale, enabling teams to test multiple concepts in parallel and kill weak ideas before development investment.

Validate·Developing

Production Copy Generation

DEL-044

Tightens the content development timeline by semi-automating microcopy and first drafts with rules governing style and tone of voice, so teams refine to production-quality copy faster.

Deliver·Established