AWS Certified Data Engineer – AssociateData Ingestion and TransformationEasy
A large manufacturing company needs to ingest operational sensor data from thousands of industrial machines located on factory floors. The data is generated continuously, with each machine producing small, frequent data points (e.g., temperature, pressure, vibration). The company requires real-time analytics on this streaming data to detect anomalies and predict maintenance needs. The solution must be highly scalable and cost-effective. Which AWS service is most appropriate for ingesting this data?
- AAWS DataSync
- BAmazon S3 Batch Operations
- CAmazon Kinesis Data Streams
- DAWS Transfer Family
Show answer & explanationAnswer & explanation
Correct answer: C. Amazon Kinesis Data Streams
Amazon Kinesis Data Streams is designed for real-time ingestion and processing of large streams of data records. Its ability to handle high throughput and low latency makes it ideal for continuous sensor data from thousands of devices.
Why the other options are wrong
- A. AWS DataSync is used for large-scale, one-time or periodic data transfers between on-premises storage and AWS storage services, not for continuous real-time streams.
- B. Amazon S3 Batch Operations is for performing large-scale batch operations on existing S3 objects, not for ingesting real-time streams.
- D. AWS Transfer Family is used for transferring files over SFTP, FTPS, and FTP, not for real-time streaming data ingestion.
Amazon Kinesis Data Streams
A highly scalable, durable, and real-time data streaming service that can continuously capture and store gigabytes of data per second from hundreds of thousands of sources.
- Real-time data ingestion
- Scalable for high throughput
- Durable storage of data streams
Memory trick: Kinesis streams flow like endless sensor data.