- All Exams Instant Download
Which of the following changes does the data scientist need to make to their objective_function in order to produce a more accurate model?
A data scientist wants to efficiently tune the hyperparameters of a scikit-learn model. They elect to use the Hyperopt library's fmin operation to facilitate this process. Unfortunately, the final model is not very accurate. The data scientist suspects that there is an issue with the objective_function being passed as an...
Which of the following tools can be used to distribute large-scale feature engineering without the use of a UDF or pandas Function API for machine learning pipelines?
Which of the following tools can be used to distribute large-scale feature engineering without the use of a UDF or pandas Function API for machine learning pipelines?A . KerasB . pandasC . PvTorchD . Spark MLE . Scikit-learnView AnswerAnswer: D Explanation: Spark ML (Machine Learning Library) is designed specifically for...
Which of the following changes can the data scientist make to address the concern?
A data scientist is using Spark ML to engineer features for an exploratory machine learning project. They decide they want to standardize their features using the following code block: Upon code review, a colleague expressed concern with the features being standardized prior to splitting the data into a training set...
Which of the Spark operations can be used to randomly split a Spark DataFrame into a training DataFrame and a test DataFrame for downstream use?
Which of the Spark operations can be used to randomly split a Spark DataFrame into a training DataFrame and a test DataFrame for downstream use?A . TrainValidationSplitB . DataFrame.whereC . CrossValidatorD . TrainValidationSplitModelE . DataFrame.randomSplitView AnswerAnswer: E Explanation: The correct method to randomly split a Spark DataFrame into training and...
Which of the following is a benefit of using vectorized pandas UDFs instead of standard PySpark UDFs?
Which of the following is a benefit of using vectorized pandas UDFs instead of standard PySpark UDFs?A . The vectorized pandas UDFs allow for the use of type hintsB . The vectorized pandas UDFs process data in batches rather than one row at a timeC . The vectorized pandas UDFs...
Which of the following values represents the overall cross-validation root-mean-squared error?
A data scientist uses 3-fold cross-validation when optimizing model hyperparameters for a regression problem. The following root-mean-squared-error values are calculated on each of the validation folds: • 10.0 • 12.0 • 17.0 Which of the following values represents the overall cross-validation root-mean-squared error?A . 13.0B . 17.0C . 12.0D ....
Which of the following describes why?
A data scientist wants to parallelize the training of trees in a gradient boosted tree to speed up the training process. A colleague suggests that parallelizing a boosted tree algorithm can be difficult. Which of the following describes why?A . Gradient boosting is not a linear algebra-based algorithm which is...
Which of the following feature engineering tasks will be the least efficient to distribute?
A machine learning engineer is trying to scale a machine learning pipeline by distributing its feature engineering process. Which of the following feature engineering tasks will be the least efficient to distribute?A . One-hot encoding categorical featuresB . Target encoding categorical featuresC . Imputing missing feature values with the meanD...
Which of the following changes does the machine learning engineer need to make to complete the task?
A machine learning engineer would like to develop a linear regression model with Spark ML to predict the price of a hotel room. They are using the Spark DataFrame train_df to train the model. The Spark DataFrame train_df has the following schema: The machine learning engineer shares the following code...
Which of the following explanations justifies this suggestion?
An organization is developing a feature repository and is electing to one-hot encode all categorical feature variables. A data scientist suggests that the categorical feature variables should not be one-hot encoded within the feature repository. Which of the following explanations justifies this suggestion?A . One-hot encoding is not supported by...
