You are noticing job cluster is taking 6 to 8 mins to start which is delaying your job to finish on time, what steps you can take to reduce the amount of time cluster startup time

You are noticing job cluster is taking 6 to 8 mins to start which is delaying your job to finish on time, what steps you can take to reduce the amount of time cluster startup time
A . Setup a second job ahead of first job to start the cluster, so the cluster is ready with re-sources when the job starts
B . Use All purpose cluster instead to reduce cluster start up time
C . Reduce the size of the cluster, smaller the cluster size shorter it takes to start the cluster
D . Use cluster pools to reduce the startup time of the jobs
E . Use SQL endpoints to reduce the startup time

View Answer

Answer: D

Explanation:

The answer is, Use cluster pools to reduce the startup time of the jobs.

Cluster pools allow us to reserve VM’s ahead of time, when a new job cluster is created VM are grabbed from the pool. Note: when the VM’s are waiting to be used by the cluster only cost incurred is Azure. Databricks run time cost is only billed once VM is allocated to a cluster.

Here is a demo of how to setup and follow some best practices, https://www.youtube.com/watch?v=FVtITxOabxg&ab_channel=DatabricksAcademy