When ingesting JSON files with unknown structure into watsonx.data using Spark; what does schema inference do?
Select an answer to reveal the explanation.
Short Explanation and Infographic
Spark's schema inference reads a sample of the JSON data and infers column names and data types automatically; this is useful for exploratory ingestion but should be replaced with explicit schemas in production for reliability.
Full explanation below image
Full Explanation
Spark's schema inference reads a sample of the JSON data and infers column names and data types automatically; this is useful for exploratory ingestion but should be replaced with explicit schemas in production for reliability. The incorrect options ("It converts the JSON to CSV format before writing to object storage", "It validates that the JSON conforms to a predefined Avro schema", "It splits the JSON file into equal partitions for parallel processing") are distractors that don't fully capture the concept described.