Kubernetes and Cloud Native Associate (KCNA)Cloud Native ObservabilityMedium
A DevOps team is setting up a centralized logging solution for their Kubernetes cluster. They need to collect logs from various sources (container stdout/stderr, application logs within files, system logs), parse them, and forward them to an Elasticsearch cluster for storage and analysis. Which CNCF-graduated project is specifically designed for this log collection and forwarding purpose?
- AJaeger
- BPrometheus
- CFluentd
- DCortex
Show answer & explanationAnswer & explanation
Correct answer: C. Fluentd
Fluentd is a robust open-source data collector for unified logging. It can collect logs from numerous sources, apply filtering and parsing rules, and then forward them to various destinations, including Elasticsearch, making it ideal for centralizing logs in a Kubernetes environment.
Why the other options are wrong
- A. Jaeger is for distributed tracing, not log collection.
- B. Prometheus is for metrics, not log collection.
- D. Cortex is a horizontally scalable, highly available, multi-tenant Prometheus implementation, not a log collector.
Fluentd
An open-source data collector for unified logging, designed to collect, parse, transform, and store data.
- Supports over 1000 plugins for various sources and destinations.
- Often used in conjunction with Elasticsearch and Kibana (ELK stack).
- Ideal for collecting logs from containerized environments.
Memory trick: Fluentd makes logs Flow from source to destination.