AWS Certified Solutions Architect – ProfessionalAccelerate Workload Migration and ModernizationEasy
A manufacturing company has an on-premises Hadoop cluster used for big data analytics. They want to migrate this workload to AWS to leverage cloud scalability and reduce operational costs associated with managing the cluster. The company prefers a managed service approach to minimize administrative overhead. Which AWS service should they use for this migration?
- ARefactor the analytics pipeline to use AWS Lambda and Amazon Kinesis.
- BMigrate the Hadoop cluster to Amazon EC2 instances and manage it manually.
- CRepurchase a dedicated analytics appliance from an AWS Marketplace vendor.
- DReplatform the Hadoop workload to Amazon EMR.
Show answer & explanationAnswer & explanation
Correct answer: D. Replatform the Hadoop workload to Amazon EMR.
Amazon EMR is a fully managed service that makes it easy to run big data frameworks, including Apache Hadoop and Apache Spark, on AWS. It provides scalability and significantly reduces the operational overhead of managing a Hadoop cluster, aligning with the company's goals.
Why the other options are wrong
- A. Refactoring to Lambda and Kinesis would be a significant re-architecture (modernization) and might not be suitable for existing Hadoop jobs without substantial effort, contradicting a direct migration/replatforming goal.
- B. Managing a Hadoop cluster manually on EC2 instances defeats the purpose of reducing administrative overhead and leveraging a managed service.
- C. Repurchasing an appliance might reduce some operational burden, but it's not a direct migration of their existing Hadoop workload to an AWS managed service and might introduce vendor lock-in specific to the appliance.
Amazon Elastic MapReduce (EMR)
A managed cluster platform that simplifies running big data frameworks like Apache Hadoop and Apache Spark on AWS to process and analyze vast amounts of data.
- Automates provisioning, managing, and scaling of big data clusters.
- Supports various big data frameworks and analytic tools.
- Integrates with other AWS services like S3 and EC2.
Memory trick: Hadoop to EMR, easy as can be.