AWS Certified Data Engineer – AssociateData Ingestion and TransformationEasy
A financial services company needs to ingest real-time transaction data from various global branches into an Amazon S3 data lake for immediate analysis. The data arrives as continuous streams of JSON records, and the company requires minimal latency and guaranteed delivery. Which AWS service is best suited for this ingestion requirement?
- AAmazon SQS
- BAWS DataSync
- CAmazon Kinesis Data Firehose
- DAWS Database Migration Service (DMS)
Show answer & explanationAnswer & explanation
Correct answer: C. Amazon Kinesis Data Firehose
Amazon Kinesis Data Firehose is designed for near real-time ingestion of streaming data into various destinations, including Amazon S3, with automatic scaling and minimal operational overhead. It supports JSON format and provides data transformation capabilities before delivery.
Why the other options are wrong
- A. Amazon SQS is a message queuing service, not designed for direct ingestion of continuous data streams into S3.
- B. DataSync is used for high-speed, online data transfer between on-premises storage and AWS storage services, not real-time streaming.
- D. DMS is primarily for migrating databases and continuous replication, not general-purpose streaming ingestion.
Amazon Kinesis Data Firehose
A fully managed service for delivering real-time streaming data to destinations like Amazon S3, Amazon Redshift, Amazon OpenSearch Service, and Splunk.
- Fully managed, no servers to provision or manage.
- Automatically scales to match data throughput.
- Supports data transformation and compression before delivery.
Memory trick: Firehose funnels streams to storage fast.