Microsoft Azure Data FundamentalsDescribe an analytics workload on AzureMedium
A company is implementing a modern data warehouse solution on Azure. They need to ensure that data from various sources (OLTP databases, SaaS applications, flat files) is regularly extracted, transformed, and loaded into their Azure Synapse Analytics dedicated SQL pool. This process needs to be automated and scheduled. Which Azure service is designed to orchestrate these data movement and transformation activities?
- AAzure Functions
- BAzure Logic Apps
- CAzure Event Grid
- DAzure Data Factory
Show answer & explanationAnswer & explanation
Correct answer: D. Azure Data Factory
Azure Data Factory is a cloud-based ETL and data integration service that allows you to create, schedule, and orchestrate data workflows (pipelines) to move and transform data from various sources.
Why the other options are wrong
- A. Azure Functions are serverless compute services for executing small pieces of code, not for orchestrating large-scale data integration workflows.
- B. Azure Logic Apps are for serverless workflows and integrations, but for complex, large-scale ETL pipelines, Data Factory is more specialized and robust.
- C. Azure Event Grid is a serverless event routing service, used for event-driven architectures, not for orchestrating ETL pipelines.
Azure Data Factory
A cloud-based ETL and data integration service that allows you to create data-driven workflows for orchestrating data movement and transforming data at scale.
- Supports connections to hundreds of data sources.
- Provides visual tools for pipeline development.
- Enables scheduling and monitoring of data integration processes.
Memory trick: Data Factory 'builds' your data pipelines.