Nightly ETL assumes one fixed schema, but a new chatbot begins dumping unstructured transcripts. What Big Data lesson applies?
Select an answer to reveal the explanation.
Short Explanation
The nightly job expected neat columns; the chatbot sent novel soup. Variety just kicked the old ETL in the shins. Flexible Big Data–style pipelines exist for exactly that bruise.
Full Explanation
Variety among sources frequently overwhelms rigid, single-schema ETL. Unstructured chatbot transcripts arriving beside structured warehouse loads exemplify the pressure. Organizations then adopt lake-style storage, schema-on-read, or specialized text pipelines. Rejecting all new sources preserves fragility rather than solving the civic need.