A data engineering team needs to implement a data catalog and governance solution for their existing data lake on Amazon S3. The solution must allow fine-grained access control to specific tables and columns, enable data discovery, and integrate with various AWS analytics services. They also want to simplify the process of setting up and managing data access permissions. Which AWS service is purpose-built for these requirements?
- AAmazon QuickSight
- BAmazon Athena
- CAWS Glue Data Catalog
- DAWS Lake Formation
Show answer & explanationAnswer & explanation
Correct answer: D. AWS Lake Formation
AWS Lake Formation is a fully managed service that simplifies building, securing, and managing data lakes. It extends the Glue Data Catalog with powerful security and governance features, including fine-grained access control (table, column, and row-level), centralized permissions management, and integration with AWS analytics services. While Glue Data Catalog provides metadata, Lake Formation adds the crucial governance and simplified permissions layer.
Why the other options are wrong
- A. Amazon QuickSight is a BI service for data visualization and analysis; it consumes data from a data lake but doesn't manage its governance or access controls.
- B. Amazon Athena is a query service that uses the Glue Data Catalog but does not provide data governance or access control management itself.
- C. AWS Glue Data Catalog stores metadata but does not provide fine-grained access control or a simplified governance layer for data lake permissions.
AWS Lake Formation
AWS Lake Formation is a service that makes it easy to build, secure, and manage data lakes by simplifying data ingestion, cleaning, transformation, and especially, the security and governance of data.
- Centralized security and governance for data lakes.
- Fine-grained access control (table, column, row-level).
- Integrates with Glue Data Catalog and AWS analytics services.
- Simplifies permission management with a grant/revoke model.
- Automates data ingestion and transformation.
Memory trick: Lake Formation's the key, for data governance, safe and free.