AWS Certified Developer – Associate (DVA-C02)Development with AWS ServicesMedium
A developer is designing a new microservice that needs to handle a high volume of real-time sensor data from IoT devices. The data needs to be ingested, processed, and then stored in a data lake for analytics. The solution must support multiple consumers reading the same data stream concurrently and guarantee the order of records within each shard. Which AWS service is best suited for the ingestion and streaming of this data?
- AAmazon DynamoDB Streams
- BAmazon Kinesis Data Streams
- CAmazon S3
- DAmazon SQS
Show answer & explanationAnswer & explanation
Correct answer: B. Amazon Kinesis Data Streams
Amazon Kinesis Data Streams is designed for real-time processing of large streams of data. It supports multiple consumers, guarantees order within shards, and is ideal for high-throughput data ingestion from sources like IoT devices, making it perfect for this scenario.
Why the other options are wrong
- A. Amazon DynamoDB Streams captures changes to DynamoDB tables; it's not a general-purpose data ingestion and streaming service for IoT data.
- C. Amazon S3 is object storage, suitable for a data lake, but not for real-time ingestion and streaming of active data.
- D. Amazon SQS is a message queuing service, not optimized for real-time streaming of large volumes of data to multiple consumers with ordering guarantees within a stream.
Amazon Kinesis Data Streams
A real-time data streaming service capable of continuously capturing and storing gigabytes of data per second from hundreds of thousands of sources.
- Real-time processing for large data streams.
- Supports multiple concurrent consumers.
- Guarantees record order within shards.
Memory trick: Kinesis streams your data, ordered and fast, from the start.