AWS Certified Data Engineer – AssociateData Ingestion and TransformationHard
A global IoT company collects sensor data from millions of devices worldwide. The data is high-volume, low-latency, and needs to be ingested, filtered, and routed to various AWS services based on rules (e.g., critical alerts to Amazon SNS, telemetry data to Amazon S3, operational metrics to Amazon Kinesis Data Streams). The solution must be fully managed, highly scalable, and support complex rule-based processing without requiring server management. Which AWS service is the MOST appropriate for this ingestion and initial routing?
- AAWS Glue Streaming ETL
- BAmazon Kinesis Data Streams
- CAmazon Kinesis Data Firehose
- DAWS IoT Core with IoT Rules Engine
Show answer & explanationAnswer & explanation
Correct answer: D. AWS IoT Core with IoT Rules Engine
AWS IoT Core provides secure, bidirectional communication between IoT devices and the AWS cloud. Its Rules Engine allows for powerful, serverless, rule-based routing and transformation of device data to multiple AWS services (S3, SNS, Kinesis, Lambda, etc.) based on defined criteria, perfectly matching the requirements for high-volume IoT data ingestion and intelligent routing.
Why the other options are wrong
- A. AWS Glue Streaming ETL is for complex, continuous data transformations, typically downstream from an ingestion service like IoT Core or Kinesis, not for initial device ingestion and rule-based routing.
- B. Amazon Kinesis Data Streams is for generic real-time data streaming, but it lacks the specific device management, authentication, and rule-based routing capabilities tailored for IoT devices that IoT Core offers.
- C. Amazon Kinesis Data Firehose is for delivering streaming data to specific destinations but doesn't offer the device management or complex rule-based routing capabilities of IoT Core.
AWS IoT Core with Rules Engine
A managed cloud platform that lets connected devices easily and securely interact with cloud applications and other devices, using a Rules Engine for data processing and routing.
- Secure device connectivity and management
- MQTT, HTTP, and WebSockets protocol support
- Rules Engine for serverless data transformation and routing
- Integrates with numerous AWS services (S3, SNS, Lambda, Kinesis, etc.)
Memory trick: IoT Core is the central brain for all your smart devices, directing their data wherever it needs to go.