Why set maxtokens thoughtfully rather than always maximum?

Question

Accepted Answer

It caps cost/latency and prevents unexpectedly huge generations; pair with clear length instructions — maxtokens is a cost/latency ceiling — set it on purpose, and also ask for concise answers.

Answer

maxtokens has no effect ever

Answer

Higher maxtokens always improves factual accuracy

Answer

It selects the model family

Why set max_tokens thoughtfully rather than always maximum?

Short Explanation and Infographic

Full Explanation