Which Spark Structured Streaming write mode would you use to continuously append new Kafka events to an Iceberg table?
Select an answer to reveal the explanation.
Short Explanation and Infographic
Append mode in Spark Structured Streaming writes only the new rows from each micro-batch to the Iceberg table; it is the correct mode for event streams where records are immutable and accumulate over time.
Full explanation below image
Full Explanation
Append mode in Spark Structured Streaming writes only the new rows from each micro-batch to the Iceberg table; it is the correct mode for event streams where records are immutable and accumulate over time. The incorrect options ("complete mode — rewrites the entire table with each micro-batch", "update mode — modifies existing rows in place based on a primary key", "overwrite mode — replaces the entire partition with each micro-batch") are distractors that don't fully capture the concept described.