CompTIA Data+ (DA0-002)Data Concepts and EnvironmentsMedium
A data engineer is designing a data ingestion pipeline for a high-traffic e-commerce website. The system needs to capture every click, view, and transaction event in real-time, with extremely high write throughput and low latency. The data will primarily be analyzed for trends over time and used for real-time dashboards showing current site activity. Which database type is BEST suited for this scenario?
- AGraph Database
- BDocument Database
- CTime-Series Database
- DRelational Database
Show answer & explanationAnswer & explanation
Correct answer: C. Time-Series Database
Time-series databases (TSDBs) are specifically optimized for handling large volumes of time-stamped data, such as real-time events from a website. They excel at high-speed ingestion and efficient querying of data based on time intervals, which is crucial for trend analysis and real-time dashboards.
Why the other options are wrong
- A. Graph databases are for relationships, not for high-volume, time-stamped event data.
- B. Document databases are flexible but not specifically designed for the performance and time-based indexing of time-series data.
- D. Relational databases are not optimized for the high write throughput and time-based querying of event data.
Time-Series Database (TSDB)
A database optimized for storing and serving time-stamped data or time series. It's designed for high ingest rates, efficient storage, and querying of data points over time.
- Optimized for data indexed by time.
- High write throughput for streaming data.
- Efficient for time-range queries and aggregate functions over time.
Memory trick: Time-series database tracks every tick, document is flexible, relational is rigid, graph is links quick.