After a tram booth adds “car barn” to Riva ASR, a supervisor wants a number before keeping the change. How should the team measure whether the customization helped?

ASR customization experiments need a word-level error style metric on a frozen held-out set so variants are comparable. Informal hallway judgments, loudspeaker loudness, or unrelated map aesthetics do not measure transcription improvement.