Microsoft Azure Data FundamentalsDescribe how to work with non-relational data on AzureMedium

A data engineer is designing a solution to store millions of small files (averaging 10 KB each) generated by IoT devices. These files need to be accessed infrequently for archival purposes and occasional batch processing. Cost optimization is a primary concern. Which Azure Blob Storage access tier is most suitable for this scenario?

  1. AArchive
  2. BPremium
  3. CCool
  4. DHot
Show answer & explanation

Correct answer: A. Archive

The Archive tier is optimized for rarely accessed data with flexible latency requirements (hours). It offers the lowest storage costs, which aligns with the need for cost optimization for infrequently accessed archival data.

Why the other options are wrong

  • B. Premium tier is for high-performance, low-latency data, which is overkill and expensive for archival.
  • C. Cool tier is for infrequently accessed data (30+ days), but Archive is cheaper for truly rare access.
  • D. Hot tier is for frequently accessed data, incurring higher storage costs.

Azure Blob Storage Archive Tier

An access tier for Azure Blob Storage optimized for data that is rarely accessed, with flexible latency requirements of several hours for retrieval.

  • Offers the lowest storage costs.
  • Higher data retrieval costs compared to Hot and Cool tiers.
  • Data can be rehydrated to Hot or Cool before access.

Memory trick: Hot for now, Cool for later, Archive for never (almost).

More Describe how to work with non-relational data on Azure questions