Microsoft Azure Data FundamentalsDescribe an analytics workload on AzureMedium
A data engineering team is designing a new analytics solution for a retail company. They need a highly scalable and cost-effective storage solution to store all raw, semi-structured, and structured data, including sales transactions, customer demographics, website clickstreams, and IoT sensor data from stores. This storage must support large file sizes and have hierarchical namespaces for organizing data. Which Azure service should they choose?
- AAzure Files
- BAzure Data Lake Storage Gen2
- CAzure SQL Database
- DAzure Table Storage
Show answer & explanationAnswer & explanation
Correct answer: B. Azure Data Lake Storage Gen2
Azure Data Lake Storage Gen2 is a highly scalable and cost-effective data lake solution built on Azure Blob Storage. It is designed to handle petabytes of data, supports various data types (raw, semi-structured, structured), and provides a hierarchical namespace that enables efficient data organization and access control, making it ideal for a central data repository for analytics.
Why the other options are wrong
- A. Azure Files is a fully managed file share service, primarily for traditional file shares, not optimized for petabyte-scale big data analytics workloads.
- C. Azure SQL Database is a relational database for structured data, not suitable for storing all raw, semi-structured, and large files at petabyte scale.
- D. Azure Table Storage is a NoSQL key-value store for structured, non-relational data, but doesn't support large files or hierarchical namespaces.
Azure Data Lake Storage Gen2
A highly scalable and cost-effective data lake solution for big data analytics, built on Azure Blob Storage with a hierarchical namespace.
- Supports petabyte-scale data and trillions of files.
- Combines Blob Storage features with a file system semantic.
- Ideal for storing raw, semi-structured, and structured data for analytics.
Memory trick: Data Lake is the vast, organized land for all your data.