Professional Data EngineerBuilding and operationalizing data processing systemsMedium
A global ride-sharing company collects real-time GPS coordinates from millions of active vehicles. This data needs to be ingested immediately, with very low latency, and then processed by a stream analytics engine to detect anomalies and optimize routes. The data volume can fluctuate significantly, peaking during rush hours. The company requires a messaging service that can handle high throughput, ensure message durability, and scale automatically without manual intervention. Which Google Cloud service is most suitable for ingesting this data?
- ACloud Storage
- BCloud SQL
- CCloud Pub/Sub
- DBigQuery
Show answer & explanationAnswer & explanation
Correct answer: C. Cloud Pub/Sub
Cloud Pub/Sub is a fully managed, real-time messaging service designed for high-throughput, low-latency data ingestion and delivery. It automatically scales to handle fluctuating data volumes and ensures message durability, making it ideal for streaming data from millions of devices.
Why the other options are wrong
- A. Cloud Storage is an object storage service, suitable for large files and batch processing, but not for real-time, low-latency messaging.
- B. Cloud SQL is a relational database service, not designed for high-throughput, real-time message queuing from millions of sources.
- D. BigQuery is a data warehousing service, optimized for analytical queries, not for ingesting real-time streams of individual messages.
Cloud Pub/Sub
A global, fully managed, real-time messaging service that allows you to send and receive messages between independent applications.
- Asynchronous messaging
- Decouples senders and receivers
- Scales automatically to handle high throughput
Memory trick: Pub/Sub is the express lane for your streaming data.