Product design
NN/G finds AI designs built from synthesised research beat ones built from raw comments by 8.4 points
NN/G researchers Megan Chan and Rachel Banawa had an AI model design a flight-rebooking form and a checkout flow from about 100 raw user comments per task, or from findings and recommendations synthesised from them. Designs from the synthesised research met 77.9% of scorecard criteria on average, against 69.5% (p < 0.001). No raw-comment rebooking design said whether the cancellation affected loyalty miles.
Why it mattersSynthesise research before you prompt a design model with it; the raw-comment designs left out details such as loyalty miles.
ScoreEasy to act on today, with an 8.4-point gain (p < 0.001); lost innovation points for a small, single-model study with an intuitive result.