AWS Certified Data Engineer – AssociateData Storage and ManagementHard

A data engineering team is building a new data lake on Amazon S3. They need to implement a robust data catalog that supports schema evolution, data quality checks, and integrates seamlessly with various analytics services like Amazon Athena and Amazon Redshift Spectrum. The solution must also provide fine-grained access control to specific tables and columns within the data lake. Which AWS service provides these capabilities?

  1. AAWS Lake Formation
  2. BAmazon OpenSearch Service
  3. CAWS Data Exchange
  4. DAmazon QuickSight
Show answer & explanation

Correct answer: A. AWS Lake Formation

AWS Lake Formation is a fully managed service that helps build, secure, and manage data lakes. It extends the AWS Glue Data Catalog with fine-grained access control, data quality blueprints, and integrates with analytics services, fulfilling all requirements.

Why the other options are wrong

  • B. Amazon OpenSearch Service (formerly Elasticsearch Service) is for search and analytics of log data and operational analytics, not a data catalog or governance solution for data lakes.
  • C. AWS Data Exchange is for finding, subscribing to, and publishing third-party data, not for managing an internal data lake's catalog and governance.
  • D. Amazon QuickSight is a BI service for data visualization and dashboards, not a data catalog or governance service for the data lake itself.

AWS Lake Formation

AWS Lake Formation is a fully managed service that helps you build, secure, and manage data lakes. It simplifies the process of building data lakes by centralizing security, governance, and cataloging, offering fine-grained access control to data.

  • Simplifies building and securing data lakes
  • Extends AWS Glue Data Catalog for governance
  • Provides fine-grained access control (table/column-level)
  • Integrates with various analytics services

Memory trick: Lake Formation secures the data, from schema to access, with grace.

More Data Storage and Management questions