You are currently asked to work on building a data pipeline, you have noticed that you are currently working on a very large scale ETL many data dependencies, which of the following tools can be used to address this problem?

You are currently asked to work on building a data pipeline, you have noticed that you are currently working on a very large scale ETL many data dependencies, which of the following tools can be used to address this problem?A . AUTO LOADER B. JOBS and TASKS C. SQL Endpoints...

March 8, 2023 No Comments READ MORE +

What would you recommend for reducing the overall cost of this approach?

You noticed that a team member started using an all-purpose cluster to develop a notebook and used the same all-purpose cluster to set up a job that can run every 30 mins so they can update un-derlying tables which are used in a dashboard. What would you recommend for reducing...

March 8, 2023 No Comments READ MORE +

You are noticing job cluster is taking 6 to 8 mins to start which is delaying your job to finish on time, what steps you can take to reduce the amount of time cluster startup time

You are noticing job cluster is taking 6 to 8 mins to start which is delaying your job to finish on time, what steps you can take to reduce the amount of time cluster startup timeA . Setup a second job ahead of first job to start the cluster, so...

March 8, 2023 No Comments READ MORE +

table(table_name))

table(table_name))A . format, checkpointlocation, schemalocation, overwrite B. cloudfiles.format, checkpointlocation, cloudfiles.schemalocation, overwrite C. cloudfiles.format, cloudfiles.schemalocation, checkpointlocation, mergeSchema D. cloudfiles.format, cloudfiles.schemalocation, checkpointlocation, overwrite E. cloudfiles.format, cloudfiles.schemalocation, checkpointlocation, appendView AnswerAnswer: C Explanation: The answer is cloudfiles.format, cloudfiles.schemalocation, checkpointlocation, mergeSchema. Here is the end to end syntax of streaming ELT, below link contains complete...

March 8, 2023 No Comments READ MORE +

Which of the following technique can be used to implement fine-grained access control to rows and columns of the Delta table based on the user's access?

Which of the following technique can be used to implement fine-grained access control to rows and columns of the Delta table based on the user's access?A . Use Unity catalog to grant access to rows and columns B. Row and column access control lists C. Use dynamic view functions D....

March 8, 2023 No Comments READ MORE +

You noticed that colleague is manually copying the notebook with _bkp to store the previous versions, which of the following feature would you recommend instead.

You noticed that colleague is manually copying the notebook with _bkp to store the previous versions, which of the following feature would you recommend instead.A . Databricks notebooks support change tracking and versioning B. Databricks notebooks should be copied to a local machine and setup source control locally to version...

March 8, 2023 No Comments READ MORE +

Which of the following technique can be used to implement fine-grained access control to rows and columns of the Delta table based on the user's access?

Which of the following technique can be used to implement fine-grained access control to rows and columns of the Delta table based on the user's access?A . Use Unity catalog to grant access to rows and columns B. Row and column access control lists C. Use dynamic view functions D....

March 8, 2023 No Comments READ MORE +