Emergency management must consume a continuous weather-alert topic into a live Delta sink from engineering notebooks. What pattern should they use?
Select an answer to reveal the explanation.
Short Explanation
You run a notebook streaming query like an emergency radio left on—weather alerts keep writing into the live Delta sink instead of waiting for a triggered query to fire. Overwriting the sink wipes out alerts you'll still need, and merging adds match logic you don't need for this append-only feed.
Full Explanation
Emergency management consuming a continuous weather-alert topic into a live Delta sink from engineering notebooks should use notebooks with a streaming query that writes alerts into that Delta sink. Structured Streaming via notebook or job keeps the live topic flowing into Delta for situational awareness instead of waiting on a triggered query to fire, which leaves gaps when alerts arrive continuously. Continuous civic alert feeds need a streaming write path with checkpoints so restarts remain safe during incidents. Notebooks with a streaming query that overwrites weather alerts into a live Delta sink lose prior alert history because each overwrite replaces the sink instead of appending new alerts for situational awareness. Notebooks with a triggered query that writes weather alerts into a live Delta sink fail continuous freshness when storms evolve hour by hour because the query runs only when triggered instead of consuming the topic continuously. Notebooks with a streaming query that merges weather alerts into a live Delta sink add unnecessary upsert logic with match conditions for an append-only alert feed, complicating the live write path when a simple streaming append is required. Exam caveat: notebook streaming is valid for engineering and can be productionized as a job; the key concept is a streaming query into a live Delta sink with checkpointing, not a triggered query, an overwrite into the sink, or merging into the sink. Operational check: attach to the weather-alert topic, start a notebook streaming query with a durable checkpoint into a Delta sink, inject a test alert, confirm it appears in Delta quickly, verify restart from checkpoint does not require a full topic replay for ops dashboards, and document on-call ownership of the stream.
Prefer to study offline? Printable PDF study book + test engine ($7.50, unofficial). These questions stay free here.