Microsoft Azure Data FundamentalsDescribe how to work with non-relational data on AzureHard
A data engineer is designing a solution to store millions of small files (averaging 10 KB each) from IoT devices. These files are generated continuously and need to be stored cost-effectively for potential future analysis. The files are rarely accessed after initial ingestion, and retrieval performance is not critical, with latencies of several minutes or even hours being acceptable. Which Azure Blob Storage access tier is the most appropriate for this scenario?
- APremium
- BHot
- CArchive
- DCool
Show answer & explanationAnswer & explanation
Correct answer: C. Archive
The Archive access tier is the most cost-effective solution for data that is rarely accessed and can tolerate retrieval latencies of several hours. Given the IoT files are small, numerous, and infrequently accessed for long-term storage, Archive tier minimizes storage costs significantly.
Why the other options are wrong
- A. Premium tier is for high-performance, low-latency scenarios and is prohibitively expensive for this archival use case.
- B. Hot tier is for frequently accessed data, which would be too expensive for millions of rarely accessed files.
- D. Cool tier is for infrequently accessed data (minimum 30 days online), but the Archive tier offers even lower storage costs for data that can tolerate longer retrieval times.
Azure Blob Storage Archive Tier
The lowest-cost storage tier for Azure Blob Storage, optimized for rarely accessed data with flexible latency requirements (hours).
- Lowest storage cost, highest retrieval cost.
- Retrieval can take several hours.
- Ideal for long-term backups, archives, compliance data.
Memory trick: Archive data is 'buried' until needed for deep dives.