D-DS-OP-23 exam

Which Sqoop validation type checks the row counts between the source and target databases, and tries to ensure that the counts match?A . ValidationThresholdB . EvalC . ValidationFailureHandlerD . ValidatorView AnswerAnswer: A

What skill is essential for a data engineer to efficiently transform and clean raw data into usable formats?A . Data visualizationB . Machine learningC . Data warehousingD . ETL (Extract, Transform, Load) processesView AnswerAnswer: D

What is the purpose of sensor operators in Apache Airflow?A . Perform validation checks in parallelB . Move data sequentially from one system to anotherC . Use triggers to report each successive retryD . Use a poke method to monitor external processesView AnswerAnswer: D

Which Python library formats data into dataframes?A . NLTKB . NumPyC . PandasD . scikit-learnView AnswerAnswer: C

What is the purpose of memory management in Apache Flink?A . Convert all of the data into Java objectsB . Control how much memory the runtime operations useC . Eliminate the need for serialization of the dataD . Ensure no disk space is ever requiredView AnswerAnswer: B

Which of the following are components of the Apache Spark architecture? (Select all that apply)A . Spark CoreB . Spark SQLC . Spark HBaseD . Spark StreamingE . Spark CassandraView AnswerAnswer: ABD

Which of the following are characteristics of the Hadoop ecosystem? (Select all that apply)A . Real-time processingB . Batch processingC . Low fault toleranceD . ScalabilityE . Single-node architectureView AnswerAnswer: BD