AWS Certified Developer – Associate (DVA-C02)Development with AWS ServicesHard
A developer is building a high-throughput, low-latency data ingestion pipeline. The application needs to process millions of small records per second from various sources and then perform real-time analytics. The data needs to be ordered and durable. Which AWS service is BEST suited for capturing and persisting this streaming data?
- AAmazon DynamoDB Streams
- BAmazon Kinesis Data Streams
- CAWS IoT Core
- DAmazon SQS
Show answer & explanationAnswer & explanation
Correct answer: B. Amazon Kinesis Data Streams
Amazon Kinesis Data Streams is a highly scalable and durable real-time data streaming service that can continuously capture gigabytes of data per second from hundreds of thousands of sources. It maintains the order of records within a shard and provides durability, making it ideal for high-throughput, low-latency ingestion for real-time analytics.
Why the other options are wrong
- A. DynamoDB Streams captures changes to DynamoDB tables for real-time processing, but it's not a generic ingestion service for data from various sources.
- C. AWS IoT Core is for connecting IoT devices and managing their data, not a general-purpose high-throughput streaming ingestion service for millions of records per second from varied sources.
- D. SQS is a message queuing service for decoupling and asynchronous processing, not designed for high-throughput, ordered, real-time data streaming and analytics.
Amazon Kinesis Data Streams
A massively scalable and durable real-time data streaming service that continuously captures gigabytes of data per second from hundreds of thousands of sources.
- Designed for real-time data ingestion and processing.
- Data is organized into shards, maintaining order within each shard.
- Provides high throughput and low latency.
- Data is durable for up to 7 days (by default, configurable up to 365 days).
Memory trick: Kinesis is the powerful river for your flowing data, keeping it in order.