Microsoft Azure Data FundamentalsDescribe core data conceptsHard
A data engineer is designing a system to store invoices, which are primarily PDF documents, along with their associated metadata (e.g., invoice number, date, vendor, total amount). The system needs to allow for full-text search within the PDF content, as well as structured queries on the metadata. Which approach BEST combines storage and indexing for this requirement?
- AStore PDFs as files on an Azure Files share and metadata in Azure Cosmos DB.
- BStore PDFs and metadata in a single Azure SQL Database table.
- CStore PDFs in Azure Blob Storage and index both content and metadata using Azure Cognitive Search.
- DStore PDFs in Azure Blob Storage and metadata in Azure Table Storage.
Show answer & explanationAnswer & explanation
Correct answer: C. Store PDFs in Azure Blob Storage and index both content and metadata using Azure Cognitive Search.
Azure Blob Storage is ideal for storing large PDF documents. Azure Cognitive Search can then be configured to ingest these blobs, extract text from the PDFs (using AI capabilities), and index both the extracted text and the associated metadata for full-text search and structured querying, providing a unified search experience.
Why the other options are wrong
- A. Azure Files lacks advanced indexing capabilities for document content, and while Cosmos DB handles metadata, it doesn't solve the full-text search in PDFs directly.
- B. Storing large PDFs directly in Azure SQL Database is inefficient and not optimized for full-text search within document content.
- D. Azure Table Storage is not suitable for full-text search within PDF content.
Azure Cognitive Search
Azure Cognitive Search is a cloud search service that provides a rich search experience over diverse content types, including text extraction from unstructured data.
- Enables full-text search, faceted navigation, and relevancy ranking.
- Integrates with AI services for content extraction and enrichment.
- Indexes data from various sources like Azure Blob Storage, Azure SQL Database.
Memory trick: Cognitive Search helps you 'see' inside your 'blobs' and 'metadata'.