Which of the following approaches can the data engineer use to set up the new task?

A data engineer has a single-task Job that runs each morning before they begin working. After identifying an upstream data issue, they need to set up another task to run a new notebook prior to the original task.

Which of the following approaches can the data engineer use to set up the new task?
A . They can clone the existing task in the existing Job and update it to run the new notebook.
B . They can create a new task in the existing Job and then add it as a dependency of the original task.
C . They can create a new task in the existing Job and then add the original task as a dependency of the new task.
D . They can create a new job from scratch and add both tasks to run concurrently.
E . They can clone the existing task to a new Job and then edit it to run the new notebook.

Answer: B

Explanation:

To set up the new task to run a new notebook prior to the original task in a single-task Job, the data engineer can use the following approach: In the existing Job, create a new task that corresponds to the new notebook that needs to be run. Set up the new task with the appropriate configuration, specifying the notebook to be executed and any necessary parameters or dependencies. Once the new task is created, designate it as a dependency of the original task in the Job configuration. This ensures that the new task is executed before the original task.

Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments