Microsoft Certified: Fabric Analytics Engineer AssociatePrepare and transform data (20-25%)Medium
A data engineer is designing a solution to ingest real-time sensor data from IoT devices into Microsoft Fabric. The data arrives as a continuous stream of JSON messages, and it needs to be immediately available for near real-time analytics. Which Fabric component is specifically designed for this type of ingestion and initial processing?
- ADataflows Gen2 with a Web connector.
- BEventstream with a custom source connector.
- CSpark Notebooks with a Structured Streaming job.
- DData Pipelines with a Copy Data activity.
Show answer & explanationAnswer & explanation
Correct answer: B. Eventstream with a custom source connector.
Eventstream in Microsoft Fabric is purpose-built for real-time data ingestion from various sources, including IoT devices, and provides capabilities for immediate processing and routing to destinations like a Lakehouse or KQL database for near real-time analytics. It handles the continuous stream nature of the data effectively.
Why the other options are wrong
- A. Dataflows Gen2 are for batch processing, not continuous real-time streams.
- C. While Spark Structured Streaming can process real-time data, Eventstream provides a more managed, low-code solution for ingestion and routing, often serving as the initial entry point for streaming data into Fabric.
- D. Data Pipelines are for batch orchestration and scheduled data movement, not real-time streaming.
Eventstream for Real-time Ingestion
Eventstream in Microsoft Fabric is a fully managed, real-time data streaming platform designed to ingest, process, and route continuous streams of data from various sources, including IoT devices, for immediate analytical consumption.
- Dedicated to real-time data streaming.
- Ingests continuous streams (e.g., IoT, logs).
- Provides initial processing and routing capabilities.
- Outputs to Lakehouse, KQL Database, or other destinations.
Memory trick: Eventstream catches real-time waves for analytics.