CompTIA Data+ (DA0-002)Data Concepts and EnvironmentsMedium
A data engineer is building a data pipeline that processes real-time sensor readings from industrial machinery. Each reading includes a timestamp, machine ID, sensor type, and a numerical value. The data needs to be stored in a way that allows for extremely fast ingestion of new data points and efficient queries over time ranges (e.g., average temperature for machine X over the last hour). Which database type is BEST suited for this scenario?
- ARelational Database
- BDocument Database
- CGraph Database
- DTime-Series Database
Show answer & explanationAnswer & explanation
Correct answer: D. Time-Series Database
Time-series databases (TSDBs) are purpose-built for handling high-volume, time-stamped data. Their architecture is optimized for rapid ingestion of new data points and efficient retrieval and aggregation of data over specific time intervals, making them ideal for sensor data and real-time monitoring.
Why the other options are wrong
- A. Relational databases are not optimized for the continuous high-volume writes and time-based querying of sensor data.
- B. Document databases are flexible but lack the specific optimizations for time-based indexing and aggregations found in TSDBs.
- C. Graph databases are for relationships between entities, not for sequential, time-stamped sensor readings.
Time-Series Database (TSDB)
A database optimized for storing and serving time-stamped data or time series. It's designed for high ingest rates, efficient storage, and querying of data points over time.
- Data indexed by time for fast retrieval.
- High write throughput for streaming data.
- Efficient for time-range queries and aggregations.
Memory trick: Time-series database tracks every tick, document is flexible, relational is rigid, graph is links quick.