Microsoft Certified: Fabric Analytics Engineer AssociatePlan and implement data analytics solutions (10-15%)Easy
A company is migrating its on-premises data warehouse to Microsoft Fabric. They have a nightly batch process that extracts data from an SAP system as CSV files and stores them on an SFTP server. The data needs to be ingested into a Lakehouse, transformed, and then loaded into a Delta table for analytical purposes. Which Fabric component is best suited for orchestrating this end-to-end data ingestion and transformation workflow?
- AData Activator
- BReal-time Analytics
- CData Pipelines
- DMicrosoft Purview
Show answer & explanationAnswer & explanation
Correct answer: C. Data Pipelines
Data Pipelines in Microsoft Fabric are designed for orchestrating and automating data movement and transformation workflows, including data ingestion from various sources like SFTP, and subsequent processing within the Lakehouse. This aligns perfectly with the described end-to-end batch process.
Why the other options are wrong
- A. Data Activator is for monitoring data and triggering actions based on data changes, not for orchestrating ingestion workflows.
- B. Real-time Analytics is for ingesting and analyzing high-volume, low-latency streaming data, which is not the primary requirement for a nightly batch process from SFTP.
- D. Microsoft Purview is for data governance, cataloging, and lineage, not for data ingestion and transformation orchestration.
Fabric Data Pipelines
Data Pipelines in Microsoft Fabric provide a cloud-native, serverless orchestration service for creating, scheduling, and managing data integration workflows (ETL/ELT).
- Supports various data sources and destinations.
- Enables data movement and transformation activities.
- Offers scheduling, monitoring, and error handling.
Memory trick: Pipelines orchestrate data flow, from source to Lakehouse.