You are tasked to set up a set notebook as a job for six departments and each department can run the task parallelly, the notebook takes an input parameter dept number to process the data by department, how do you go about to setup this up in job?

You are tasked to set up a set notebook as a job for six departments and each department can run the task parallelly, the notebook takes an input parameter dept number to process the data by department, how do you go about to setup this up in job?A . Use...

March 17, 2023 No Comments READ MORE +

Which of the following functions can be used to convert JSON string to Struct data type?

Which of the following functions can be used to convert JSON string to Struct data type?A . TO_STRUCT (json value) B. FROM_JSON (json value) C. FROM_JSON (json value, schema of json) D. CONVERT (json value, schema of json) E. CAST (json value as STRUCT)View AnswerAnswer: C Explanation: Syntax Copy

March 17, 2023 No Comments READ MORE +

You are currently asked to work on building a data pipeline, you have noticed that you are currently working on a very large scale ETL many data dependencies, which of the following tools can be used to address this problem?

You are currently asked to work on building a data pipeline, you have noticed that you are currently working on a very large scale ETL many data dependencies, which of the following tools can be used to address this problem?A . AUTO LOADER B. JOBS and TASKS C. SQL Endpoints...

March 17, 2023 No Comments READ MORE +

What is the purpose of a silver layer in Multi hop architecture?

What is the purpose of a silver layer in Multi hop architecture?A . Replaces a traditional data lake B. Efficient storage and querying of full and unprocessed history of data C. A schema is enforced, with data quality checks. D. Refined views with aggregated data E. Optimized query performance for...

March 17, 2023 No Comments READ MORE +

You are noticing job cluster is taking 6 to 8 mins to start which is delaying your job to finish on time, what steps you can take to reduce the amount of time cluster startup time

You are noticing job cluster is taking 6 to 8 mins to start which is delaying your job to finish on time, what steps you can take to reduce the amount of time cluster startup timeA . Setup a second job ahead of first job to start the cluster, so...

March 17, 2023 No Comments READ MORE +

Which of the following describes how Databricks Repos can help facilitate CI/CD workflows on the Databricks Lakehouse Platform?

Which of the following describes how Databricks Repos can help facilitate CI/CD workflows on the Databricks Lakehouse Platform?A . Databricks Repos can facilitate the pull request, review, and approval process before merging branches B. Databricks Repos can merge changes from a secondary Git branch into a main Git branch C....

March 17, 2023 No Comments READ MORE +

table(table_name))

table(table_name))A . format, checkpointlocation, schemalocation, overwrite B. cloudfiles.format, checkpointlocation, cloudfiles.schemalocation, overwrite C. cloudfiles.format, cloudfiles.schemalocation, checkpointlocation, mergeSchema D. cloudfiles.format, cloudfiles.schemalocation, checkpointlocation, overwrite E. cloudfiles.format, cloudfiles.schemalocation, checkpointlocation, appendView AnswerAnswer: C Explanation: The answer is cloudfiles.format, cloudfiles.schemalocation, checkpointlocation, mergeSchema. Here is the end to end syntax of streaming ELT, below link contains complete...

March 17, 2023 No Comments READ MORE +