A tide-mill visitor kiosk can speak a two-sentence summary or display the entire millwright transcript next to a gear photo. The team runs both and scores whether visitors find the right gear. What is the right success measure?
Select an answer to reveal the explanation.
Short Explanation
The kiosk wins when a visitor points at the right gear — not when the text is merely shorter. Measure the job at the photo, under both summary and full-transcript conditions.
Full Explanation
Comparing summarization versus raw text is meaningful only against a multimodal visitor task. Scoring whether guests find the correct gear ties the text-arm conditions to real success. “Shorter is always better,” speech rate alone, or diffusion-style similarity are the wrong metrics for this experiment.