AWS Certified Data Engineer – AssociateData Ingestion and TransformationEasy
A global manufacturing company needs to ingest real-time operational metrics from thousands of factory floor sensors. These sensors generate high-volume, low-latency data streams that must be processed for immediate anomaly detection and stored for historical analysis. The solution must be fully managed and scalable to handle millions of data points per second. Which AWS service is the MOST appropriate for ingesting this data?
- AAWS Transfer Family
- BAWS DataSync
- CAmazon S3
- DAmazon Kinesis Data Streams
Show answer & explanationAnswer & explanation
Correct answer: D. Amazon Kinesis Data Streams
Amazon Kinesis Data Streams is specifically designed for real-time ingestion of high-volume, low-latency data streams, making it ideal for sensor data and immediate processing needs. It provides the necessary scalability and durability for this use case.
Why the other options are wrong
- A. AWS Transfer Family is for secure file transfers using SFTP, FTPS, or FTP, not real-time data streaming.
- B. AWS DataSync is used for large-scale data transfer between on-premises and AWS, not real-time streaming ingestion.
- C. Amazon S3 is an object storage service, suitable for storing data but not for real-time, low-latency ingestion of streaming data directly.
Amazon Kinesis Data Streams
A real-time data streaming service that can continuously capture and store terabytes of data per hour from hundreds of thousands of sources.
- High-throughput, low-latency ingestion
- Scalable to millions of data points per second
- Data available within milliseconds for processing
- Integrated with other AWS services for analytics and storage
Memory trick: Kinesis streams data like a fast river, always flowing.