A national retail chain operates hundreds of physical stores. Each store generates daily sales reports, inventory updates, and employee time clock data. This data needs to be collected efficiently from each store, transformed, and then loaded into a central data warehouse in Azure for business intelligence and reporting. The solution must handle a large number of concurrent data transfers from geographically dispersed locations. Which data integration solution would be most effective for collecting data from the on-premises stores to Azure?
- AAzure Event Grid
- BAzure Data Box
- CAzure Data Factory with Self-hosted Integration Runtime
- DAzure ExpressRoute
Show answer & explanationAnswer & explanation
Correct answer: C. Azure Data Factory with Self-hosted Integration Runtime
Azure Data Factory with a Self-hosted Integration Runtime is ideal for connecting to on-premises data sources securely and efficiently. The Integration Runtime acts as a gateway in each store, allowing Data Factory to orchestrate data movement, transformation, and loading from hundreds of geographically dispersed locations to Azure.
Why the other options are wrong
- A. Azure Event Grid is an event routing service for reacting to events, not for orchestrating scheduled ETL pipelines from on-premises data sources.
- B. Azure Data Box is for offline data transfer of very large datasets (terabytes to petabytes), not for ongoing, scheduled daily/hourly data collection.
- D. Azure ExpressRoute provides a private, dedicated network connection to Azure, but it's a networking solution, not a data integration or orchestration service for scheduling and transforming data.
Azure Data Factory Self-hosted Integration Runtime
A Self-hosted Integration Runtime (SHIR) is a compute infrastructure used by Azure Data Factory to provide data integration capabilities across different network environments. It is installed on an on-premises machine or a VM within a private network and enables secure, managed data transfer between on-premises data stores and Azure services.
- Connects Azure Data Factory to on-premises data sources
- Acts as a secure gateway for data movement
- Executes Data Factory activities on-premises
- Essential for hybrid data integration scenarios
- Scalable by installing multiple SHIR nodes
Memory trick: SHIR in each store, Data Factory collects all.