AWS Certified Data Engineer – AssociateData Storage and ManagementMedium
A data engineer needs to store a vast amount of historical sensor data from thousands of IoT devices. This data arrives continuously, is time-series in nature, and requires near real-time ingestion and query capabilities for operational monitoring and anomaly detection. The solution must be highly scalable, fully managed, and cost-effective for petabytes of data. Which AWS service is purpose-built for this use case?
- AAmazon RDS for MySQL
- BAmazon DynamoDB
- CAmazon S3
- DAmazon Timestream
Show answer & explanationAnswer & explanation
Correct answer: D. Amazon Timestream
Amazon Timestream is a fast, scalable, and serverless time-series database service for IoT and operational applications. It is purpose-built to handle the unique demands of time-series data, offering high throughput ingestion, efficient storage, and powerful analytical functions, making it ideal for the described scenario.
Why the other options are wrong
- A. Amazon RDS for MySQL is a relational database. It is not optimized for the high-volume, continuous ingestion, and specific query patterns of time-series data, making it inefficient and potentially costly for petabyte-scale IoT data.
- B. Amazon DynamoDB is a NoSQL key-value and document database. While scalable, it's not purpose-built for time-series data patterns, which can lead to complex data modeling and less efficient queries compared to Timestream.
- C. Amazon S3 is object storage and while it can store large amounts of data, it is not optimized for time-series ingestion and real-time querying for operational monitoring.
Amazon Timestream
A fast, scalable, and serverless time-series database service that makes it easy to store and analyze petabytes of time-series data.
- Purpose-built for time-series data (IoT, operational apps)
- High throughput ingestion and efficient storage
- Serverless and fully managed
- SQL-like query language with time-series functions
Memory trick: Timestream is the 'Time' machine for your 'Stream' of IoT data.