Professional Data EngineerEnsuring solution qualityMedium
A global e-commerce company is migrating its on-premises data warehouse to BigQuery. The data warehouse contains sensitive customer payment information, order history, and product preferences. The company operates in multiple regions and must comply with GDPR, CCPA, and other regional data residency and privacy regulations. You need to design the data governance strategy to ensure data discovery, classification, lineage tracking, and policy enforcement across the BigQuery environment. Which Google Cloud service is best suited for this purpose?
- ADataproc Metastore.
- BData Catalog.
- CSecurity Command Center.
- DCloud Data Loss Prevention (DLP) API.
Show answer & explanationAnswer & explanation
Correct answer: B. Data Catalog.
Data Catalog is a fully managed, scalable metadata management service that enables data discovery, classification, lineage tracking (when integrated with other services), and policy tagging, making it ideal for comprehensive data governance and compliance, especially with BigQuery.
Why the other options are wrong
- A. Dataproc Metastore is a managed Apache Hive Metastore service, primarily for Dataproc and other Apache Spark/Hive ecosystems, not a general-purpose data catalog for BigQuery.
- C. Security Command Center is a security and risk management platform, focusing on vulnerabilities and threats, not data cataloging or governance.
- D. Cloud DLP API is primarily for discovering, classifying, and redacting sensitive data, but it doesn't provide a full data catalog with lineage or policy enforcement across assets.
Google Cloud Data Catalog
A fully managed, scalable metadata management service that helps organizations discover, understand, and manage all their data assets.
- Centralized metadata repository.
- Enables data discovery and search.
- Supports policy tagging and lineage.
Memory trick: Data Catalog is like the library's card catalog for your cloud data: it helps you find, understand, and manage everything.