AWS Certified Data Engineer – AssociateData Ingestion and TransformationEasy
A large enterprise needs to ingest real-time operational metrics from thousands of on-premises servers into AWS for monitoring and analysis. The data consists of small, frequent updates (e.g., CPU utilization, memory usage) and must be delivered to Amazon S3 for long-term storage and Amazon CloudWatch for immediate visualization. The solution must be highly available, scalable, and minimize operational overhead. Which AWS service is most appropriate for ingesting this data?
- AAmazon Kinesis Data Firehose
- BAWS Database Migration Service (DMS)
- CAWS DataSync
- DAWS Transfer Family (SFTP)
Show answer & explanationAnswer & explanation
Correct answer: A. Amazon Kinesis Data Firehose
Amazon Kinesis Data Firehose is designed for reliable and scalable ingestion of streaming data into various AWS destinations, including S3 and CloudWatch, with minimal operational overhead and automatic scaling.
Why the other options are wrong
- B. AWS DMS is for migrating databases, not for ingesting real-time operational metrics from servers.
- C. AWS DataSync is primarily used for large-scale data transfers between on-premises storage and AWS, not real-time streaming of small, frequent metrics.
- D. AWS Transfer Family (SFTP) is for file transfers, not real-time streaming metrics, and requires managing SFTP clients.
Amazon Kinesis Data Firehose
A fully managed service for delivering real-time streaming data to destinations like Amazon S3, Amazon Redshift, Amazon OpenSearch Service, and Splunk, without managing servers.
- Automatically scales to match data throughput.
- Supports data transformation and conversion.
- Integrates with various AWS services for destinations.
Memory trick: Firehose funnels fast data to cloud storage.