Which method would be most appropriate for ingesting a large historical dataset from an on-premises relational database into watsonx.data?
Select an answer to reveal the explanation.
Short Explanation and Infographic
Bulk historical data migration from relational databases is best handled by ETL tools (DataStage) or Spark JDBC jobs that extract data in parallel batches; transform as needed; and write optimized Iceberg/Parquet files.
Full explanation below image
Full Explanation
Bulk historical data migration from relational databases is best handled by ETL tools (DataStage) or Spark JDBC jobs that extract data in parallel batches; transform as needed; and write optimized Iceberg/Parquet files. The incorrect options ("Real-time Kafka streaming with micro-batch Spark consumers", "Pointing Presto directly at the on-premises database and running INSERT INTO ... SELECT statements", "Manually exporting CSV files and dragging them into the watsonx.data UI") are distractors that don't fully capture the concept described.