A research institution is building a data lake on Google Cloud using Cloud Storage. They have numerous research projects, each generating large volumes of diverse data (structured, semi-structured, unstructured). To ensure proper data governance, they need a centralized way to discover, understand, and manage metadata for all their data assets, regardless of where they reside within the data lake. This includes tracking schema, lineage, and business descriptions. Which Google Cloud service is best suited for this requirement?
- ACloud Storage Transfer Service
- BCloud SQL
- CCloud Data Catalog
- DBigQuery
Show answer & explanationAnswer & explanation
Correct answer: C. Cloud Data Catalog
Cloud Data Catalog is a fully managed, scalable metadata management service that allows organizations to discover, manage, and understand all their data assets across Google Cloud and hybrid environments. It provides features for tagging, lineage, and schema discovery, directly addressing the institution's need for centralized metadata management and data governance.
Why the other options are wrong
- A. Cloud Storage Transfer Service is for moving data between storage locations, not for metadata management or discovery.
- B. Cloud SQL is a relational database service, not a metadata management solution for a data lake.
- D. BigQuery is a data warehouse for analytics, not a metadata catalog for diverse data assets across a data lake.
Cloud Data Catalog
Cloud Data Catalog is a fully managed metadata management service that helps organizations discover, organize, and understand their data assets across Google Cloud and beyond. It provides a centralized repository for technical and business metadata, enabling better data governance and data discovery.
- Centralized metadata management for diverse data assets.
- Supports data discovery, lineage tracking, and schema inference.
- Integrates with various Google Cloud data services (BigQuery, Cloud Storage, Pub/Sub).
- Enables data governance by providing context and understanding of data.
Memory trick: Catalog your data, like books in a library.