Step2Study

AWS Certified Machine Learning – Specialty practice questions

243 free questions with answers and explanations.

Practice test
  1. 51.A data science team is developing a new machine learning model for a critical real-time application. They need to ensure that the model can be deployed rapidly and reliably, with automated testing and versioning. The team also wants to maintain a clear audit trail of all model changes and deployments. Which AWS MLOps service provides a managed workflow orchestration for building, training, and deploying ML models, including automated steps for testing and versioning?Machine Learning Implementation and Operations
  2. 52.A data engineering team is building an MLOps pipeline for a fraud detection model. They need to ensure that all data used for training and inference is traceable and auditable. Specifically, they want to log all input features, model predictions, and any associated metadata for every inference request. This data will be used for model debugging, bias detection, and compliance auditing. Which SageMaker feature should be enabled on the real-time endpoint?Machine Learning Implementation and Operations
  3. 53.A financial institution is deploying a new machine learning model to predict fraudulent transactions. To minimize the risk of a faulty model impacting live operations, they want to test the new model (Model B) by sending copies of live production traffic to it, while the existing production model (Model A) continues to serve all actual responses to users. The predictions of Model B will be logged and compared against Model A's predictions and actual outcomes offline. Which deployment strategy should they use?Machine Learning Implementation and Operations
  4. 54.A data science team has developed a new machine learning model for real-time anomaly detection. They need to deploy this model to production with minimal downtime and the ability to quickly roll back to the previous version if any issues are detected. Which deployment strategy should they implement to meet these requirements?Machine Learning Implementation and Operations
  5. 55.A financial institution is deploying a new machine learning model to predict fraudulent transactions in real-time. Due to strict compliance requirements, all data exchanged with the SageMaker inference endpoint, including requests and responses, must be encrypted in transit. Which security measure should be implemented to meet this requirement?Machine Learning Implementation and Operations
  6. 56.A data science team is developing a new fraud detection model. They need to deploy this model to a SageMaker real-time endpoint. During development, they noticed that the model's predictions sometimes contain sensitive customer information in the output, which should not be exposed. The team needs to implement a mechanism to redact or transform sensitive data in the inference response before it reaches the end application. Which approach should they use?Machine Learning Implementation and Operations
  7. 57.A data science team is building a personalized content recommendation system. They need to frequently retrain their models with fresh data and deploy new model versions automatically, ensuring reproducibility and version control for all steps from data processing to model deployment. Which AWS service is specifically designed to orchestrate and automate these end-to-end machine learning workflows?Machine Learning Implementation and Operations
  8. 58.A machine learning engineer is deploying a large language model (LLM) on Amazon SageMaker for real-time inference. The LLM is several tens of billions of parameters, making it too large to fit into the memory of a single GPU instance or even multiple GPUs on a single instance without significant performance degradation. The engineer needs to optimize the inference performance and reduce latency by distributing the model across multiple GPU instances. Which SageMaker optimization technique is designed for this scenario?Machine Learning Implementation and Operations
  9. 59.A media company uses a content moderation model deployed on a SageMaker real-time endpoint. The model's predictions are critical, and any downtime or service degradation could lead to significant business impact. The MLOps team wants to establish a robust CI/CD pipeline that automatically builds, tests, and deploys new model versions. A key requirement is to ensure that the new model is gradually rolled out to production, starting with a very small percentage of live traffic, and automatically rolls back if performance metrics (e.g., latency, error rate) exceed predefined thresholds. Which SageMaker deployment strategy, integrated with a CI/CD pipeline, should be used?Machine Learning Implementation and Operations
  10. 60.A large e-commerce company uses an ML model for real-time product recommendations. The model is deployed on a SageMaker endpoint that experiences highly variable traffic patterns throughout the day, with significant spikes during peak shopping seasons and promotional events. To ensure cost-effectiveness and high availability, the solution must automatically scale the endpoint's inference capacity up and down based on demand. Which SageMaker feature should be configured?Machine Learning Implementation and Operations
  11. 61.A data scientist is deploying a new anomaly detection model to a SageMaker real-time endpoint. During testing, they observe that the endpoint sometimes fails to start up within the default timeout period when deploying new model versions, especially for larger models or those with complex initialization logic. This leads to deployment failures and increased downtime. To resolve this, they need to increase the time SageMaker waits for the container to become healthy after deployment. Which parameter should be adjusted?Machine Learning Implementation and Operations
  12. 62.A data science team is deploying a new machine learning model for real-time recommendations. They want to ensure that the model's performance does not degrade over time due to changes in input data distributions. They need a proactive mechanism to detect such degradation and trigger alerts for intervention. Which SageMaker feature should they use?Machine Learning Implementation and Operations
  13. 63.A data scientist is deploying a new object detection model to an Amazon SageMaker endpoint. During initial testing, the endpoint occasionally fails to become `InService`, reporting `ClientError: Could not find model data` in the logs, even though the model artifact is correctly uploaded to S3. The data scientist suspects the model container is not fully ready to serve predictions before SageMaker considers it healthy. Which parameter should the data scientist adjust to resolve this issue?Machine Learning Implementation and Operations
  14. 64.A data science team needs to implement a robust MLOps practice where new model versions are automatically trained, evaluated, and deployed based on new incoming data or schedule. They want to define a series of steps, including data preprocessing, model training, model evaluation, and conditional deployment, as an automated workflow. Which AWS service is best suited for building and managing these end-to-end ML pipelines?Machine Learning Implementation and Operations
  15. 65.A security team needs to ensure that machine learning models deployed in production adhere to strict compliance requirements, including data access controls and encryption at rest and in transit. For an Amazon SageMaker endpoint, where should the data scientist configure the encryption settings for the model artifacts and the communication channels?Machine Learning Implementation and Operations
  16. 66.A data science team is deploying a new machine learning model for real-time inference on Amazon SageMaker. They need to ensure that if an Availability Zone (AZ) becomes unhealthy, inference traffic is automatically routed to healthy AZs with minimal downtime. Which SageMaker deployment configuration best addresses this requirement?Machine Learning Implementation and Operations
  17. 67.A pharmaceutical company is developing a machine learning model to assist in drug discovery. The model is a large transformer-based architecture deployed on an Amazon SageMaker endpoint. While the model provides high accuracy, the inference latency is a critical concern, and the GPU instances required are expensive. The team wants to optimize the inference cost and latency without compromising model accuracy. Which SageMaker feature should they use to achieve this?Machine Learning Implementation and Operations
  18. 68.A data engineering team is building a new feature store to manage features for various machine learning models across their organization. They need a solution that can serve both online inference requests (low-latency, real-time access) and offline training jobs (high-throughput, batch access). Additionally, the solution must provide versioning of features and allow for easy discovery and reuse. Which AWS service or feature is best suited for this requirement?Machine Learning Implementation and Operations
  19. 69.A healthcare provider uses a machine learning model to assist in patient diagnosis. Due to strict regulatory compliance, every inference made by the model must be logged, and the logs must be immutable and verifiable for audit purposes over several years. The provider uses Amazon SageMaker for model deployment. Which AWS service integration with SageMaker would best meet these requirements?Machine Learning Implementation and Operations
  20. 70.A financial services company is deploying a new fraud detection model. Due to the critical nature of the application, they need to validate the new model's performance against the existing production model using real-world traffic without impacting current users. They want to gradually shift a small percentage of live traffic to the new model, monitor its performance, and then progressively increase traffic if successful. Which deployment strategy is best suited for this requirement?Machine Learning Implementation and Operations
  21. 71.A financial institution is deploying a new fraud detection model. The model is highly accurate but requires a very low-latency response time for real-time transactions. The current deployment strategy uses a single SageMaker endpoint. To ensure high availability and minimize latency spikes during peak loads, the institution wants to implement a strategy that automatically adjusts the number of inference instances based on traffic while distributing requests across multiple Availability Zones. Which SageMaker feature should be used?Machine Learning Implementation and Operations
  22. 72.A data science team is developing a critical machine learning model for real-time anomaly detection. They want to introduce a new version of the model to production without directly impacting live users and gather performance metrics against real production traffic. Only after thorough evaluation with live data will they consider switching over. Which deployment strategy should they use?Machine Learning Implementation and Operations
  23. 73.A data science team has developed a new image classification model using PyTorch. They need to deploy this model to an Amazon SageMaker endpoint for real-time inference. The model requires specific PyTorch versions and libraries not included in the standard SageMaker PyTorch containers. To ensure the model runs correctly, the team wants to package their custom environment with the model. Which is the most efficient and recommended approach for deploying this custom environment?Machine Learning Implementation and Operations
  24. 74.A financial services company is developing a new credit risk assessment model. They want to ensure that the model is fair and does not exhibit bias against specific demographic groups (e.g., age, gender, ethnicity) before it is deployed to production. They also need to understand which features contribute most to the model's predictions for regulatory compliance and transparency. Which Amazon SageMaker service is specifically designed to address these requirements?Machine Learning Implementation and Operations
  25. 75.A machine learning team is optimizing their inference costs for a high-volume, low-latency application using SageMaker real-time endpoints. They have identified that the current instance type is underutilized during off-peak hours but experiences bottlenecks during peak times. They want to automatically adjust the number of instances based on the incoming traffic load to improve cost-efficiency and maintain performance. Which SageMaker feature should they implement?Machine Learning Implementation and Operations
  26. 76.A data science team is building a large language model (LLM) for a natural language processing application. The model is extremely large, exceeding the memory capacity of a single GPU, and inference latency is a critical performance metric. They need to deploy this model on an Amazon SageMaker endpoint and minimize inference time by distributing the model across multiple GPUs or instances. Which SageMaker feature is designed to handle this specific challenge?Machine Learning Implementation and Operations
  27. 77.A data science team has developed a new image classification model using a custom TensorFlow 2.x environment with specific dependencies not available in standard SageMaker TensorFlow containers. They need to deploy this model to a SageMaker real-time endpoint. The solution must ensure that the inference environment accurately replicates their development environment to avoid dependency conflicts and ensure consistent model behavior. What is the most appropriate method to achieve this?Machine Learning Implementation and Operations
  28. 78.A large e-commerce company uses a machine learning model to personalize product recommendations. The model is deployed on a SageMaker real-time endpoint. The data science team frequently updates the model (e.g., weekly) and wants to introduce new model versions to a small subset of users (e.g., 5%) before rolling it out to all users. They need to monitor the performance of the new model version against the current production model without impacting the majority of users. Which deployment strategy should they employ?Machine Learning Implementation and Operations
  29. 79.A retail company uses a machine learning model to recommend products to customers. The model was initially trained on historical purchase data. Over time, the company observes a decline in recommendation accuracy, despite no changes in the underlying customer behavior or product catalog. This suggests that the relationship between features and targets might have changed. Which model monitoring technique should be employed to detect this specific issue and trigger retraining?Machine Learning Implementation and Operations
  30. 80.A machine learning engineer is tasked with deploying a large language model (LLM) for a natural language processing application. The LLM has billions of parameters, making it challenging to fit into the memory of a single GPU instance and leading to high inference latency. The engineer needs to optimize the deployment for both memory efficiency and low inference latency. Which SageMaker feature is specifically designed to address this challenge for large models during inference?Machine Learning Implementation and Operations
  31. 81.A data science team is deploying a new machine learning model for real-time inference on Amazon SageMaker. They observe that during peak load, the model's latency increases significantly, leading to a degraded user experience. The team wants to ensure that the prediction latency remains consistent even under varying traffic patterns. Which SageMaker feature should they implement to automatically adjust the inference capacity based on demand?Machine Learning Implementation and Operations
  32. 82.A data science team has developed a new image classification model using a custom deep learning framework that is not natively supported by Amazon SageMaker's built-in algorithms. They need to deploy this model for real-time inference on SageMaker. Which approach should they use to package and deploy their model?Machine Learning Implementation and Operations
  33. 83.A machine learning engineer is tasked with deploying a large language model (LLM) for a natural language processing application. The LLM has billions of parameters and requires significant GPU memory and computational power, making single-instance deployment cost-prohibitive and latency-prone. The engineer needs to optimize the deployment for both cost and inference latency while handling the model's massive size. Which SageMaker feature is best suited for this scenario?Machine Learning Implementation and Operations
  34. 84.A large e-commerce company uses an ML model for real-time fraud detection. The model processes millions of transactions per hour, and high availability is paramount. Any downtime or performance degradation could lead to significant financial losses. The company needs to ensure that the inference endpoint remains operational and performs optimally even during AWS Availability Zone outages or instance failures. Which SageMaker deployment configuration best addresses this requirement?Machine Learning Implementation and Operations
  35. 85.A retail company uses a machine learning model for dynamic pricing recommendations. The model's performance has recently degraded, leading to suboptimal pricing and reduced revenue. Upon investigation, the data science team found that the distribution of key input features, such as customer purchase history and product popularity trends, has significantly changed over the past month. Which MLOps practice should the team immediately implement to address this issue and prevent future occurrences?Machine Learning Implementation and Operations
  36. 86.A media company uses a machine learning model to personalize content recommendations for its users. The model is deployed on a SageMaker real-time endpoint. Over time, the data science team observes that the model's recommendations are becoming less relevant, even though the input data schema has not changed. This indicates that the relationship between the input features and the target variable has evolved. The team needs to implement a strategy to address this gradual decay in model relevance. Which MLOps practice is most appropriate for mitigating this issue?Machine Learning Implementation and Operations
  37. 87.A development team wants to implement a robust MLOps practice where new model versions are automatically retrained and deployed upon detection of data drift or significant performance degradation. This process should be fully automated and trigger subsequent stages only if the previous stage is successful. Which design pattern best describes this automated, event-driven retraining and deployment workflow?Machine Learning Implementation and Operations
  38. 88.A retail company uses a machine learning model to predict customer churn. The model was trained on historical data and deployed as a SageMaker real-time endpoint. Over time, the company observes that the model's accuracy on new data has significantly degraded, even though the input data schema remains consistent. The distribution of customer behavior patterns has subtly shifted due to new market trends. What type of model monitoring issue is the company most likely experiencing?Machine Learning Implementation and Operations
  39. 89.A startup is building a personalized content recommendation system. They need to experiment with different model architectures and feature sets frequently to improve recommendation quality. Each experiment involves training a new model, deploying it, and evaluating its performance in a live environment against the current production model, often for a limited period to collect metrics. They want to ensure that these experiments can be run in parallel without affecting the core user experience for the majority of users. Which MLOps practice is best suited for this scenario?Machine Learning Implementation and Operations
  40. 90.A manufacturing company uses a machine learning model to predict equipment failures. The model is deployed on an Amazon SageMaker endpoint. To reduce inference costs, the company wants to utilize specialized hardware accelerators to improve throughput and reduce latency without provisioning full GPU instances, as the model's complexity does not warrant it. Which SageMaker feature allows attaching fractional GPU power to CPU instances for cost-effective acceleration?Machine Learning Implementation and Operations
  41. 91.A company is using a SageMaker real-time endpoint for a critical application. They need to minimize the cold start time for the endpoint when scaling up or after updates. The model is large, and loading it into memory takes a significant amount of time. Which SageMaker endpoint configuration parameter can directly address this issue by pre-loading the model onto instances?Machine Learning Implementation and Operations
  42. 92.A large e-commerce platform uses an ML model for real-time fraud detection. The model processes a massive volume of transactions, and the ML team needs to ensure that all input requests and corresponding model predictions are systematically recorded for auditing, debugging, and future model retraining purposes. This data must be stored securely and be easily accessible for analysis. Which SageMaker feature should they enable on their real-time endpoint?Machine Learning Implementation and Operations
  43. 93.A data science team is developing a new credit scoring model. They want to ensure that the model does not unfairly discriminate against certain demographic groups. Before deploying the model, they need to analyze the model's predictions for potential biases across different sensitive attributes such as age, gender, and income level. Which SageMaker capability is specifically designed for this purpose?Machine Learning Implementation and Operations
  44. 94.A machine learning team is setting up a CI/CD pipeline for their SageMaker models. They want to automate the process of building, testing, and deploying new model versions. Which AWS service is best suited to orchestrate and automate these various stages of the MLOps pipeline, including data preparation, model training, and model deployment?Machine Learning Implementation and Operations
  45. 95.A healthcare provider is deploying a diagnostic ML model that processes sensitive patient data. Due to strict regulatory compliance (e.g., HIPAA), they must ensure that all inference requests and responses to and from the SageMaker endpoint are fully encrypted in transit. Which mechanism should be configured to meet this security requirement?Machine Learning Implementation and Operations
  46. 96.A healthcare provider is deploying a new diagnostic ML model that processes sensitive patient health information (PHI). Regulatory compliance requires that all inference requests and responses are encrypted both in transit and at rest. The model is deployed to an Amazon SageMaker real-time endpoint. Which combination of SageMaker configurations ensures both in-transit and at-rest encryption for the inference data?Machine Learning Implementation and Operations
  47. 97.A data science team is developing a new credit scoring model. They want to ensure that the model does not exhibit unintended bias based on protected attributes like gender or ethnicity. Before deploying the model, they need to perform a comprehensive analysis of potential biases in the training data and the model's predictions. Which AWS SageMaker tool should they use for this purpose?Machine Learning Implementation and Operations
  48. 98.A healthcare provider is deploying a new diagnostic ML model. Due to strict data privacy regulations, all model artifacts, inference code, and any temporary data generated during inference must be encrypted at rest. The SageMaker endpoint serving the model must also use encrypted storage. Which AWS service is primarily used to manage the encryption keys for these resources within SageMaker?Machine Learning Implementation and Operations
  49. 99.A data engineering team is setting up an MLOps pipeline for a fraud detection model. They need to ensure that feature data used for training and inference is consistent, versioned, and easily accessible across different stages of the ML lifecycle. The features should also be available for both batch processing (training) and low-latency real-time lookups (inference). Which AWS service is best suited for this requirement?Machine Learning Implementation and Operations
  50. 100.A media company uses a content moderation model deployed on a SageMaker real-time endpoint. They have developed an improved version of the model (Model B) and want to deploy it with minimal risk, gradually shifting traffic from the current production model (Model A) to Model B. They need to observe Model B's performance with a small percentage of live traffic before fully committing. Which deployment strategy should they use?Machine Learning Implementation and Operations