Microsoft Azure Data FundamentalsDescribe core data conceptsHard
A data engineer is tasked with collecting and storing telemetry data from millions of smart home devices. Each device sends small packets of data (e.g., temperature, light levels, motion detection) every few seconds. The primary requirement is to ingest this data at extremely high velocity and then perform near real-time analytics to monitor device health and trigger alerts. Which Azure service is BEST suited for the ingestion of this data?
- AAzure SQL Database
- BAzure Blob Storage
- CAzure Data Lake Storage Gen2
- DAzure Event Hubs
Show answer & explanationAnswer & explanation
Correct answer: D. Azure Event Hubs
Azure Event Hubs is a highly scalable data streaming platform and event ingestion service specifically designed to handle millions of events per second from various sources, making it ideal for high-velocity telemetry data ingestion from IoT devices for real-time processing.
Why the other options are wrong
- A. Azure SQL Database is for transactional data and not optimized for high-volume, continuous event ingestion.
- B. Azure Blob Storage is for general-purpose object storage, not optimized for real-time, high-velocity event ingestion and streaming.
- C. Azure Data Lake Storage Gen2 is for storing large volumes of data, but it's a storage layer, not a real-time event ingestion platform.
Azure Event Hubs
A highly scalable data streaming platform and event ingestion service that can receive and process millions of events per second.
- Designed for high-throughput, low-latency data ingestion.
- Ideal for IoT telemetry, application logging, clickstreams.
- Acts as a 'front door' for data pipelines, buffering events.
- Integrates with stream processing engines like Azure Stream Analytics.
Memory trick: Event Hubs is the 'express lane' for all your streaming data.