Google Cloud Digital LeaderData and AI with Google CloudHard
An analytics team needs to perform complex, ad-hoc queries on petabytes of diverse datasets, including customer clickstream data, sales records, and inventory logs, which are stored in various formats in Cloud Storage. They want to avoid ETL processes for data that doesn't require pre-processing and leverage a serverless query engine that can directly query data where it resides. Which Google Cloud product meets these requirements?
- ACloud Spanner
- BCloud SQL
- CBigQuery Omni
- DCloud Dataproc
Show answer & explanationAnswer & explanation
Correct answer: C. BigQuery Omni
BigQuery Omni extends BigQuery's analytical capabilities to data stored in other clouds (like AWS S3 or Azure Blob Storage) and, importantly, allows direct querying of data in Google Cloud Storage without requiring it to be moved into BigQuery's native storage. This aligns perfectly with the need for ad-hoc queries on diverse datasets in Cloud Storage without ETL.
Why the other options are wrong
- A. Cloud Spanner is a globally distributed relational database, not designed for direct querying of arbitrary files in Cloud Storage.
- B. Cloud SQL is a relational database, not suitable for querying petabytes of diverse data directly from Cloud Storage.
- D. Cloud Dataproc is a managed Spark/Hadoop service, which can query data in Cloud Storage, but BigQuery Omni offers a serverless, SQL-native experience without managing clusters.
BigQuery Omni
A multi-cloud analytics solution that allows BigQuery users to analyze data stored in Google Cloud, AWS, and Azure without moving the data.
- Extends BigQuery's query engine to external data sources.
- Enables querying data in Cloud Storage directly.
- Serverless and uses standard SQL.
Memory trick: BigQuery Omni queries 'Omni' (all) your data, wherever it lives.