You are currently asked to work on building a data pipeline, you have noticed that you are currently working on a very large scale ETL many data dependencies, which of the following tools can be used to address this problem?

You are currently asked to work on building a data pipeline, you have noticed that you are currently working on a very large scale ETL many data dependencies, which of the following tools can be used to address this problem?A . AUTO LOADER B. JOBS and TASKS C. SQL Endpoints...

March 15, 2023 No Comments READ MORE +

What steps need to be taken to set up a DELTA LIVE PIPELINE as a job using the workspace UI?

What steps need to be taken to set up a DELTA LIVE PIPELINE as a job using the workspace UI?A . DELTA LIVE TABLES do not support job cluster B. Select Workflows UI and Delta live tables tab, under task type select Delta live tables pipeline and select the notebook...

March 15, 2023 No Comments READ MORE +

FROM carts GROUP BY cartId

FROM carts GROUP BY cartId Expected result: cartId items 1 [1,100,200,300,250]A . FLATTEN, COLLECT_UNION B. ARRAY_UNION, FLATTEN C. ARRAY_UNION, ARRAY_DISTINT D. ARRAY_UNION, COLLECT_SET E. ARRAY_DISTINCT, ARRAY_UNIONView AnswerAnswer: D Explanation: COLLECT SET is a kind of aggregate function that combines a column value from all rows into a unique list ARRAY_UNION...

March 15, 2023 No Comments READ MORE +

You noticed that colleague is manually copying the notebook with _bkp to store the previous versions, which of the following feature would you recommend instead.

You noticed that colleague is manually copying the notebook with _bkp to store the previous versions, which of the following feature would you recommend instead.A . Databricks notebooks support change tracking and versioning B. Databricks notebooks should be copied to a local machine and setup source control locally to version...

March 15, 2023 No Comments READ MORE +