AWS Certified Machine Learning – SpecialtyData EngineeringEasy
A data engineer is working with a large dataset of customer reviews stored in Amazon S3. The reviews contain various emojis, special characters, and HTML tags that need to be removed before the data can be used for sentiment analysis. The dataset is several terabytes in size and needs to be processed efficiently. Which AWS service is most suitable for performing this large-scale text cleaning and preprocessing?
- AAmazon Athena
- BAmazon Textract
- CAWS Glue
- DAmazon Comprehend
Show answer & explanationAnswer & explanation
Correct answer: C. AWS Glue
AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development. It is highly scalable and suitable for large-scale ETL (Extract, Transform, Load) jobs, including text cleaning and preprocessing.
Why the other options are wrong
- A. Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standard SQL. It is not designed for large-scale data transformation or cleaning.
- B. Amazon Textract is a machine learning service that automatically extracts text and data from scanned documents. It is not for cleaning existing text data.
- D. Amazon Comprehend is a natural language processing (NLP) service that uses machine learning to find insights and relationships in text. While it can analyze text, it is not primarily a data cleaning or preprocessing tool for raw input text data like AWS Glue.
AWS Glue for Data Transformation
AWS Glue is a serverless data integration service that facilitates ETL (Extract, Transform, Load) operations, including data cleaning, transformation, and preparation for analytics and machine learning.
- Serverless and scalable
- Apache Spark-based for distributed processing
- Includes Glue Data Catalog for metadata management
- Supports various data sources and targets
Memory trick: To clean up text data at scale, remember Glue is your best ally.