Environmental sensors drop millions of tiny one-reading files onto HDFS each day. What classic problem should the platform team anticipate?
Select an answer to reveal the explanation.
Short Explanation
A library card catalog with a card per sticky note collapses under its own weight. Millions of tiny sensor files do that to the NameNode’s metadata. Compact or batch them—don’t celebrate a flood of postage-stamp files as healthy HDFS design.
Full Explanation
Each HDFS file consumes NameNode metadata. Extremely large numbers of tiny files inflate that metadata footprint and hurt efficient processing. Classic guidance is to avoid the small-files problem by compaction or batched landing. HDFS can store small files, but the pattern is a poor fit at municipal sensor scale.