Microsoft Azure Data FundamentalsDescribe core data conceptsHard
A data architect is designing a solution to store log files generated by various applications and services across an enterprise. These log files are typically unstructured text, vary significantly in size, and are generated continuously at high volume. The company needs to retain these logs for auditing and occasional analytical queries, but immediate, real-time querying of individual log entries is not a primary concern. Which Azure storage option is MOST suitable for this scenario?
- AAzure Database for PostgreSQL
- BAzure Data Lake Storage Gen2
- CAzure SQL Database
- DAzure Cosmos DB (SQL API)
Show answer & explanationAnswer & explanation
Correct answer: B. Azure Data Lake Storage Gen2
Azure Data Lake Storage Gen2 is optimized for storing massive amounts of unstructured and semi-structured data, like log files, at low cost, with hierarchical namespaces for organization and analytics at scale.
Why the other options are wrong
- A. Azure Database for PostgreSQL is a relational database and not suitable for unstructured log files.
- C. Azure SQL Database is for structured relational data, not unstructured log files.
- D. Azure Cosmos DB is a NoSQL database suitable for flexible data models and real-time access, but not the most cost-effective for raw, unstructured logs for occasional queries.
Azure Data Lake Storage Gen2
A highly scalable and cost-effective data lake solution for big data analytics, built on Azure Blob Storage.
- Combines the scalability of Blob Storage with Data Lake capabilities (hierarchical namespace).
- Supports HDFS-compatible access, making it suitable for big data analytics frameworks.
- Ideal for storing raw, unstructured, and semi-structured data at petabyte scale.
Memory trick: Data Lake for Logs: A Vast, Organized Forest