A windmill flour loft concatenates millions of pixel numbers with a twelve-token note, and the stills drown the sentence. What known early-fusion weakness does that illustrate?
Select an answer to reveal the explanation.
Short Explanation
Glue a mountain of pixels to a short note and the mountain wins. Early fusion’s classic weakness is raw scale mismatch before the sides are made comparable.
Full Explanation
Early concatenation of raw or low-level features can let a high-dimensional modality overwhelm a smaller one when scales are not comparable. The fix is thoughtful representation design—not claiming encoding is useless, that late fusion is the same thing, or that cross-attention is forbidden.