Another recipe never shows the future: the model always predicts the next word of a captain’s memoir given only the words so far. Which objective is that?
Select an answer to reveal the explanation.
Short Explanation
A memoir model that only ever guesses the next word from the words so far is doing causal language modeling. That is the decoder LLM recipe. Masked modeling peeks both ways, and neither a residual tree nor a shortest lock route is the next-word objective.
Full Explanation
Causal language modeling predicts the next token from the past only. That is decoder-style pretraining. BERT-style masking uses both sides; trees and graph paths are different families.