AWS Certified Machine Learning – Specialty practice questions

243 free questions with answers and explanations.

201.A retail company is developing a recommendation system for clothing based on customer purchase history and browsing behavior. They observe that the system frequently recommends popular, generic items and struggles to surface diverse or niche products, even for customers with eclectic tastes. This leads to a lack of personalization and potential 'filter bubbles'. Which type of bias is the system exhibiting, and what is the primary cause?Modeling
202.A research team is training a deep neural network for medical image classification. They observe that the model achieves very high accuracy on the training data but performs poorly on new, unseen data, indicating overfitting. The team has already tried increasing the dataset size and adding dropout layers. To further mitigate overfitting and improve generalization without significantly increasing training time, which hyperparameter adjustment for the Adam optimizer should they consider, and why?Modeling
203.A data scientist is evaluating a binary classification model for predicting a rare disease. The model's performance is assessed using various metrics. The business requirement prioritizes minimizing false negatives, as missing a positive case (disease present) is considered far more costly than a false positive (healthy person incorrectly diagnosed with the disease). Which metric should the data scientist focus on optimizing?Modeling
204.A data scientist is working on a binary classification problem to predict customer churn. They have trained several models and observed the following performance metrics on a held-out test set: Model A: Accuracy = 0.92, Precision = 0.85, Recall = 0.70, F1-score = 0.77 Model B: Accuracy = 0.88, Precision = 0.90, Recall = 0.65, F1-score = 0.76 Model C: Accuracy = 0.90, Precision = 0.80, Recall = 0.82, F1-score = 0.81 Model D: Accuracy = 0.93, Precision = 0.75, Recall = 0.90, F1-score = 0.82 The business team emphasizes that identifying as many churning customers as possible is critical, even if it means a higher rate of incorrectly flagging non-churning customers. Which model should the data scientist recommend?Modeling
205.A machine learning team is developing a model to predict house prices. They have collected a dataset with various features like square footage, number of bedrooms, location, and year built. After initial training, they find that the model consistently underpredicts high-value houses and overpredicts low-value houses. This indicates a potential issue with the model's ability to capture the non-linear relationship between features and target variable, especially at the extremes. Which model training approach is most likely to resolve this issue?Modeling
206.A healthcare startup is developing a machine learning model to diagnose a rare disease from patient medical records. The dataset is extremely small, with only 100 positive cases and 1000 negative cases. Due to the rarity of the disease and the high cost of data collection, acquiring more data is not feasible. The team initially tried a complex deep learning model, but it showed severe overfitting. Which modeling approach is generally most suitable for such a scenario (very small dataset, limited positive samples, high cost of data acquisition)?Modeling
207.A data scientist is training a recommendation system for an e-commerce platform. The system uses collaborative filtering and has been deployed. However, the team observes that newly added items (cold-start items) rarely get recommended, and new users (cold-start users) receive generic or irrelevant recommendations. Which approach would best address this 'cold-start' problem?Modeling
208.A machine learning engineer is training a deep learning model for image classification. During training, the model's accuracy on the training set steadily increases, reaching nearly 100%, but its accuracy on a separate validation set plateaus and then starts to decrease. The engineer suspects overfitting. Which of the following techniques would be most effective in mitigating this issue?Modeling
209.A data science team is developing a machine learning model to classify customer reviews as positive, negative, or neutral. They are using a large pre-trained language model and fine-tuning it on their specific review dataset. During evaluation, they observe that the model performs exceptionally well on common review phrases but struggles with less frequent, domain-specific terminology, leading to lower-than-expected accuracy for certain review categories. Which of the following techniques would be most effective in addressing this issue without significantly increasing model complexity or training time?Modeling
210.A machine learning engineer is building a recommendation system for a new e-commerce platform. The platform has just launched, and there is very little user interaction data available. As a result, the recommendation system struggles to provide relevant suggestions for new users and newly added products. This phenomenon is commonly known as the 'cold-start problem'. Which recommendation system strategy is best suited to address this issue by leveraging item attributes or content information?Modeling
211.A financial institution is developing a machine learning model to predict loan default. The dataset is highly imbalanced, with only 2% of loans resulting in default. The team initially trained a model that achieved 98% accuracy. However, upon closer inspection, they found that the model simply predicts 'no default' for all cases. The business stakeholders are most concerned about identifying as many actual defaulting loans as possible to intervene early. Which evaluation metric should the team prioritize to address the stakeholders' primary concern?Modeling
212.A financial institution is developing a machine learning model to predict stock price movements. They have historical data spanning several years, including daily opening, closing, high, and low prices, as well as trading volume. The data exhibits strong temporal dependencies, where past prices significantly influence future prices. Which type of model architecture is best suited for capturing these sequential patterns for time series forecasting?Modeling
213.A retail company is developing a machine learning model to forecast product demand. The data scientist observes that the model performs well on recent data but struggles to predict demand accurately during holiday seasons or major promotional events, which are characterized by sudden, significant spikes in sales. The current model architecture is a simple Recurrent Neural Network (RNN). Which modification to the model training, specifically regarding the algorithm or architecture, is most likely to improve its ability to capture these sporadic, high-impact events?Modeling
214.A data science team is developing a machine learning model to predict customer churn. They observe that the dataset is highly imbalanced, with a very small percentage of customers actually churning. The business objective is to identify as many churning customers as possible to intervene proactively, even if it means some false positives. Which evaluation metric should the team prioritize to align with this objective?Modeling
215.A machine learning engineer is training a deep neural network for image classification. They observe that the model's training loss is decreasing steadily, but the validation loss has started to increase significantly after a certain number of epochs. The model is exhibiting high variance. Which of the following techniques is most appropriate to address this issue?Modeling
216.A machine learning engineer is deploying a model to production that predicts customer sentiment from text reviews. The business stakeholders require not only accurate predictions but also a robust explanation for why a particular review was classified as positive or negative, highlighting the key words or phrases. Which explainability technique is best suited for providing local, interpretable explanations for individual predictions?Modeling
217.A data scientist is performing hyperparameter tuning for a Random Forest model. They have a limited computational budget and need to find a good set of hyperparameters efficiently. They are considering tuning 'n_estimators', 'max_depth', and 'min_samples_split'. Which hyperparameter tuning strategy is most efficient for exploring a wide range of values for multiple hyperparameters within a constrained budget, while still aiming for a good performing model?Modeling
218.A research team is developing a machine learning model to detect anomalies in sensor data from critical industrial equipment. A false negative (failing to detect an actual anomaly) could lead to catastrophic equipment failure and significant financial losses. A false positive (flagging normal operation as anomalous) is undesirable but less critical, leading to unnecessary inspections. Which of the following evaluation strategies is most appropriate for optimizing this model?Modeling
219.A machine learning team is developing a credit risk assessment model using a neural network. They are concerned about the model's robustness and potential vulnerabilities to subtle, imperceptible perturbations in input data that could lead to misclassifications. They want to systematically test if small, targeted changes to input features can trick the model into making incorrect predictions with high confidence. Which technique is designed to generate such perturbations and evaluate model robustness?Modeling
220.A data scientist is performing hyperparameter tuning for a Random Forest model. They have a limited computational budget and need to explore the hyperparameter space efficiently to find a good combination of parameters. They are particularly interested in finding a global optimum rather than just a locally optimal one. Which hyperparameter tuning strategy is generally considered more efficient and robust for this scenario compared to a simple Grid Search?Modeling
221.A team is developing a computer vision model to detect defects in manufactured products. They have collected a large dataset of images, but a significant portion of them are mislabeled or contain noise due to imperfect data collection. Training on this noisy data leads to suboptimal model performance and poor generalization. Which model training technique is most appropriate to mitigate the impact of noisy labels and improve the model's robustness?Modeling
222.An autonomous driving company is developing a perception system using a deep learning model to detect pedestrians. The model performs well in standard daylight conditions, but its performance significantly degrades in adverse weather conditions (e.g., heavy rain, fog) or low light. The company wants to ensure the model's robustness and reliability across all operating environments. Which evaluation strategy is most critical to identify and address these performance gaps?Modeling
223.A computer vision team is training a deep neural network for object detection in autonomous vehicles. They are using a large dataset of annotated images. During training, they observe that the model's performance on the validation set is significantly worse than on the training set, indicating overfitting. They also notice that the model makes very confident but incorrect predictions on some validation images. Which hyperparameter or technique, if tuned or applied correctly, is most likely to specifically address the issue of overconfident predictions and improve generalization by smoothing the model's output distribution?Modeling
224.A healthcare startup is building a machine learning model to predict patient readmission rates. They are integrating patient data from multiple sources, and they notice that the 'diagnosis_code' field has various inconsistent formats (e.g., 'ICD-10-CM: J45.909', 'J45909', 'J45.909 Asthma'). This inconsistency will hinder model performance. Which data cleaning step should be prioritized to address this issue?Exploratory Data Analysis
225.A retail company is analyzing sales data from their e-commerce platform. They want to determine if there is a statistically significant difference in average daily sales between two distinct marketing campaigns (Campaign A vs. Campaign B). The sales data for both campaigns are normally distributed, and the variances are assumed to be equal. Which statistical test should they use?Exploratory Data Analysis
226.A data scientist is analyzing sensor data from industrial machinery. The data contains several time-series features, such as 'temperature', 'vibration', and 'pressure'. They need to detect unusual spikes or drops in 'temperature' that could indicate potential equipment malfunction. The data exhibits a clear seasonal pattern (daily cycles). Which anomaly detection technique is most suitable for this scenario?Exploratory Data Analysis
227.A data scientist is analyzing a large dataset of customer reviews to identify common themes and keywords. They want to create a visual representation where the prominence of a word is directly proportional to its frequency in the text. Which visualization technique is best suited for this purpose?Exploratory Data Analysis
228.A machine learning engineer is tasked with building a model to predict equipment failure based on sensor readings. The dataset contains 100 highly correlated sensor features, making the model complex and prone to overfitting. They need to reduce the dimensionality of the dataset while retaining as much variance as possible for the prediction task. Which technique is most appropriate?Exploratory Data Analysis
229.A data scientist is preparing a dataset for a machine learning model. They notice that a significant portion of a numerical feature, 'customer_age', is missing. Directly removing rows with missing values would lead to substantial data loss. Which imputation strategy is most appropriate if the distribution of 'customer_age' is heavily skewed and they want to minimize the impact of outliers on the imputed values?Exploratory Data Analysis
230.A data scientist is performing Exploratory Data Analysis (EDA) on a dataset of customer demographics. They want to investigate if there is a statistically significant association between two categorical variables: 'customer_segment' (e.g., 'New', 'Regular', 'VIP') and 'preferred_communication_channel' (e.g., 'Email', 'SMS', 'Phone'). Which statistical test is most appropriate to determine this association?Exploratory Data Analysis
231.A financial institution is analyzing credit card transaction data to detect fraudulent activities. They want to identify the strength and direction of the linear relationship between 'transaction_amount' and 'transaction_frequency_per_day' to see if unusual combinations might indicate fraud. Which statistical measure is most appropriate for this analysis?Exploratory Data Analysis
232.A data scientist is performing exploratory data analysis on a dataset containing customer demographics and their subscription status (subscribed/not subscribed). They want to visualize the relationship between 'Age' (continuous) and 'Subscription Status' (categorical binary) to understand if age plays a role in subscription. Which visualization technique is most suitable for this purpose?Exploratory Data Analysis
233.A data scientist is analyzing a dataset of customer purchase histories. They want to understand if there is a statistically significant difference in the average purchase amount between customers who used a promotional code and those who did not. The purchase amounts are normally distributed, and the sample sizes for both groups are large. Which statistical test should be used?Exploratory Data Analysis
234.A data scientist is analyzing a dataset containing customer ratings for various products on an e-commerce platform. The distribution of ratings is heavily skewed towards positive values, and there are a few extremely low ratings that could be considered outliers. They need to calculate a measure of central tendency that is least affected by this skewness and these outliers. Which statistical measure should they choose?Exploratory Data Analysis
235.A data scientist is working with a highly skewed dataset of customer income, where a few customers have extremely high incomes, significantly distorting the mean. The goal is to transform this data to achieve a more symmetrical distribution, which is a common assumption for many machine learning models. Which transformation is most appropriate in this scenario?Exploratory Data Analysis
236.A data engineer is working with a large transactional dataset. They observe that some transaction amounts are extremely high, significantly deviating from the majority of transactions. Directly using the mean and standard deviation to identify outliers would be misleading due to the influence of these extreme values. Which statistical rule, robust to extreme values, should be used to define 'outliers' for this dataset?Exploratory Data Analysis
237.A data scientist is analyzing a large dataset of customer reviews. They want to identify common themes and topics discussed in the reviews without predefining categories. Which unsupervised learning technique is most appropriate for this task?Exploratory Data Analysis
238.A data engineering team is building a feature store for a machine learning pipeline. They have a numerical feature, 'customer_session_duration_seconds', which is heavily right-skewed with a long tail of very high values. The machine learning model (e.g., linear regression) they plan to use performs better with normally distributed features. To reduce skewness and stabilize variance, which transformation should they apply, ensuring no issues with zero or negative values?Exploratory Data Analysis
239.A data scientist is analyzing a dataset of customer demographics, including 'age' and 'income'. They want to visualize the joint distribution of these two continuous variables, specifically to identify areas of high customer density without making assumptions about the underlying distribution shape. Which visualization technique is most suitable?Exploratory Data Analysis
240.A data engineering team is designing a new machine learning pipeline that will process sensitive customer data. They need to ensure that the data is encrypted both at rest and in transit, and that access to the encryption keys is tightly controlled and auditable. Which AWS service and encryption method should be prioritized to meet these requirements for data stored in Amazon S3?Data Engineering
241.A data scientist is analyzing a dataset of customer demographics. They want to understand the relationship between 'age' (numerical) and 'preferred communication channel' (categorical: Email, SMS, Phone). Which statistical test is most appropriate for determining if there is a statistically significant association between these two variables?Exploratory Data Analysis
242.A data science team is developing a machine learning model to predict the likelihood of a rare medical condition based on patient data. The dataset available is very small, containing only 200 patient records, with a highly imbalanced class distribution for the rare condition. The team is concerned about overfitting and generalization performance due to the limited data. Which modeling approach is most appropriate for this scenario?Modeling
243.A data engineering team is designing a data lake for a new machine learning initiative. The data lake will store petabytes of raw sensor data, historical transaction logs, and customer interaction data. Due to compliance requirements, all data must be encrypted at rest. The team also needs to ensure that the encryption keys are managed centrally and that access to these keys is logged and audited. Which AWS encryption option for Amazon S3 best meets these requirements?Data Engineering