How would you ingest real-time event streams from Apache Kafka into watsonx.data?
Select an answer to reveal the explanation.
Short Explanation and Infographic
Spark Structured Streaming is the standard approach for consuming Kafka topics and writing to Iceberg tables; it provides exactly-once semantics and can write optimized micro-batches to watsonx.data storage.
Full explanation below image
Full Explanation
Spark Structured Streaming is the standard approach for consuming Kafka topics and writing to Iceberg tables; it provides exactly-once semantics and can write optimized micro-batches to watsonx.data storage. The incorrect options ("Configure Presto to directly subscribe to Kafka topics for continuous ingest", "Use IBM DataStage batch jobs running every 15 minutes to poll Kafka", "Enable the Kafka connector in Infrastructure Manager to stream topics directly to object storage") are distractors that don't fully capture the concept described.