A zoo gift-shop kiosk must answer hours questions in about one second. An overnight rewrite of the volunteer handbook can take several minutes. Which factor should drive the model and hosting choice?
Select an answer to reveal the explanation.
Short Explanation
Think of a kiosk that has one second versus a handbook rewrite that can sit overnight. Latency picks the path. A catchy name and a BLEU score do not make the kiosk faster.
Full Explanation
Latency is a first-class selection factor. A one-second kiosk answer needs a fast model or hosting path; a minutes-long overnight rewrite can use a slower one. A catchy name does not meet a one-second budget. Forcing the slowest model onto the kiosk fails the front desk. BLEU does not measure wait time.