You have configured AUTO LOADER to process incoming IOT data from cloud object storage every 15 mins, recently a change was made to the notebook code to update the processing logic but the team later realized that the notebook was failing for the last 24 hours, what steps team needs to take to reprocess the data that was not loaded after the notebook was corrected?
You have configured AUTO LOADER to process incoming IOT data from cloud object storage every 15 mins, recently a change was made to the notebook code to update the processing logic but the team later realized that the notebook was failing for the last 24 hours, what steps team needs to take to reprocess the data that was not loaded after the notebook was corrected?
A . Move the files that were not processed to another location and manually copy the files into the ingestion path to reprocess them
B . Enable back_fill = TRUE to reprocess the data
C . Delete the checkpoint folder and run the autoloader again
D . Autoloader automatically re-processes data that was not loaded
E . Manually re-load the data
Answer: D
Explanation:
The answer is,
Autoloader automatically re-processes data that was not loaded using the checkpoint.
Latest Databricks Certified Data Engineer Professional Dumps Valid Version with 278 Q&As
Latest And Valid Q&A | Instant Download | Once Fail, Full Refund