AWS Certified Machine Learning – SpecialtyMachine Learning Implementation and OperationsMedium
A retail company is deploying a new personalized recommendation model. To minimize risk, they want to gradually shift traffic from the old model (Model A) to the new model (Model B), carefully monitoring Model B's performance and impact on key business metrics like conversion rate. If Model B performs worse than expected, they need to be able to quickly revert to Model A. Which deployment strategy should they employ?
- AShadow Deployment
- BA/B Testing
- CCanary Deployment
- DBlue/Green Deployment
Show answer & explanationAnswer & explanation
Correct answer: C. Canary Deployment
Canary deployment allows gradually routing a small percentage of live traffic to the new model (Model B) while the majority still goes to the old model (Model A). This enables real-time monitoring of the new model's performance with actual user traffic. If issues arise, traffic can be instantly rolled back to Model A, minimizing impact. This fits the requirement for gradual shifting and quick rollback.
Why the other options are wrong
- A. Shadow deployment sends production traffic to both models but only uses the old model's predictions, primarily for testing without affecting live users, not for gradual rollout.
- B. A/B testing is for comparing two models side-by-side to determine which performs better, but it's not primarily a deployment strategy for gradual rollout and rollback.
- D. Blue/Green deployment switches all traffic at once or in large blocks after testing, which doesn't allow for gradual traffic shifting and monitoring of a small percentage.
Canary Deployment
A deployment strategy where a new version of an application or model is incrementally rolled out to a small subset of users before a full rollout.
- Reduces risk by exposing new version to limited users
- Allows real-time performance monitoring with live traffic
- Enables quick rollback to the old version if issues arise
- Often used in conjunction with A/B testing
Memory trick: Deploy like a canary, small flight first, then the flock.