Professional Data EngineerDesigning data processing systemsMedium

A media streaming company is building a new recommendation engine that suggests content to users based on their real-time viewing habits. The engine requires extremely low-latency access to user profiles and viewing history, with consistent read and write performance even under high concurrency. The data model is relatively simple, consisting of key-value pairs and wide-column structures. Which Google Cloud database service should they choose?

  1. ACloud SQL
  2. BBigQuery
  3. CFirestore
  4. DCloud Bigtable
Show answer & explanation

Correct answer: D. Cloud Bigtable

Cloud Bigtable is a fully managed, NoSQL wide-column database service ideal for large analytical and operational workloads requiring high throughput and low latency. Its design makes it perfect for recommendation engines and time-series data where consistent performance under heavy load is critical.

Why the other options are wrong

  • A. Cloud SQL is a relational database and excels at OLTP, but may struggle with the extreme scale and low-latency requirements of a global recommendation engine.
  • B. BigQuery is an analytical data warehouse, optimized for complex queries over large datasets, but not for real-time, low-latency operational lookups.
  • C. Firestore is a NoSQL document database, suitable for mobile and web applications, but Cloud Bigtable offers higher throughput and lower latency for petabyte-scale operational data.

Cloud Bigtable for Low-Latency Operational Data

Cloud Bigtable is a sparsely populated table that can scale to billions of rows and thousands of columns, enabling petabyte-scale data storage with very high throughput and low-latency access for operational workloads.

  • NoSQL wide-column store.
  • Designed for high throughput and low latency.
  • Ideal for time-series data, IoT, and operational analytics.

Memory trick: Bigtable is the 'Big, Fast Table' for your operational needs.

More Designing data processing systems questions