Microsoft Certified: Azure Solutions Architect ExpertDesign data storage solutionsMedium
A manufacturing company uses several legacy on-premises systems that generate proprietary data in various formats (CSV, XML, fixed-width files) daily. This data needs to be extracted, transformed, and loaded (ETL) into an Azure Synapse Analytics Dedicated SQL pool for business intelligence reporting. The process needs to be orchestrated, monitored, and scheduled to run nightly. Which Azure service is best suited for building this data integration solution?
- AAzure Event Hubs
- BAzure Logic Apps
- CAzure Data Factory
- DAzure Stream Analytics
Show answer & explanationAnswer & explanation
Correct answer: C. Azure Data Factory
Azure Data Factory is a cloud-based ETL and data integration service that allows you to create, schedule, and orchestrate data workflows. It can connect to various on-premises and cloud data sources, transform data, and load it into destinations like Azure Synapse Analytics, making it ideal for this batch ETL scenario.
Why the other options are wrong
- A. Azure Event Hubs is for real-time event ingestion and streaming, not for orchestrating batch ETL processes from diverse file formats.
- B. Azure Logic Apps are for serverless workflow automation and integration, suitable for simpler integrations but not as robust for complex, large-scale ETL pipelines as Data Factory.
- D. Azure Stream Analytics is for real-time stream processing and analytics, not for scheduled batch data integration from varied file types.
Azure Data Factory
A cloud-based ETL and data integration service that allows you to create data-driven workflows for orchestrating data movement and transformation.
- Supports connections to numerous on-premises and cloud data sources.
- Provides visual tools for pipeline development and monitoring.
- Ideal for batch processing and scheduled data integration tasks.
Memory trick: Data Factory builds pipelines, ETL's best friend.