Microsoft Azure Data FundamentalsDescribe core data conceptsHard
A data architect is designing a solution for storing log files generated by various applications. These log files are unstructured text, arrive continuously, and need to be stored cost-effectively for long-term retention and occasional analysis. The primary requirement is to store them as-is without immediate schema enforcement. Which Azure storage option is MOST appropriate?
- AAzure SQL Database
- BAzure Database for MySQL
- CAzure Cache for Redis
- DAzure Data Lake Storage Gen2
Show answer & explanationAnswer & explanation
Correct answer: D. Azure Data Lake Storage Gen2
Azure Data Lake Storage Gen2 is a highly scalable and cost-effective storage solution built on Azure Blob Storage. It's optimized for big data analytics workloads, can store massive amounts of unstructured data like log files as-is, and supports hierarchical namespaces for better organization, making it ideal for long-term retention and occasional analysis.
Why the other options are wrong
- A. Azure SQL Database is for structured, relational data, not unstructured log files.
- B. Azure Database for MySQL is a relational database, unsuitable for unstructured log storage.
- C. Azure Cache for Redis is an in-memory data store for high-performance caching, not long-term storage of log files.
Azure Data Lake Storage Gen2
Azure Data Lake Storage Gen2 is a set of capabilities dedicated to big data analytics, built on Azure Blob Storage. It offers a hierarchical file system and high throughput for analytics workloads.
- Massively scalable storage for big data.
- Supports unstructured, semi-structured, and structured data.
- Cost-effective for long-term retention.
- Optimized for analytics engines like Apache Spark and Hadoop.
Memory trick: Data Lake: A 'lake' for 'all' your data, big and small.