A community shortwave logger keeps adding fields to show-log records while older files must still be readable. Writers need a compact row format that carries the schema with the data. Which format supports that evolution better than CSV?

Short Explanation

Think of a shortwave logger that keeps adding fields while older files still have to open. Apache Avro carries the schema with the row. A CSV header is not that evolution, and ORC is the warehouse scan layout.

Full Explanation

Apache Avro is the compact, row-oriented, schema-with-the-data choice for evolving producers. CSV headers do not make older files safely readable after field adds. ORC is the warehouse scan layout. Screenshots are not a record format.

×