A clerk needs a nightly 10-row lookup of holiday parking exceptions…

Question

A clerk needs a nightly 10-row lookup of holiday parking exceptions. What is the most appropriate tooling judgment?

Accepted Answer

Skip a Spark cluster for a tiny cron SQL lookup; reserve Spark for large parallel workloads — You do not call the fire department to change a light bulb. A ten-row holiday list is a small cron SQL job, not a reason to spin up a Spark cluster.

Answer

Always allocate a full Spark cluster for every municipal SQL task

Answer

Require HDFS replication before any ten-row query can run

Answer

Use Kafka partitions solely to store the ten exception rows

A clerk needs a nightly 10-row lookup of holiday parking exceptions. What is the most appropriate tooling judgment?

Short Explanation

Full Explanation