AWS Certified SysOps Administrator – AssociateMonitoring, Logging, and RemediationMedium
A company is migrating its on-premises application logs to AWS. They need a cost-effective solution to ingest logs from various sources, including custom applications and operating systems, into a centralized location for long-term archiving and occasional analysis. The solution should minimize operational overhead.
- ADeploy Amazon Kinesis Agent on-premises to send logs to Amazon Kinesis Firehose, which then delivers to Amazon S3.
- BUse AWS DataSync to transfer logs from on-premises to Amazon S3.
- CInstall and configure Fluentd on-premises to send logs directly to Amazon CloudWatch Logs.
- DSet up an AWS Storage Gateway File Gateway to sync log files to Amazon S3.
Show answer & explanationAnswer & explanation
Correct answer: A. Deploy Amazon Kinesis Agent on-premises to send logs to Amazon Kinesis Firehose, which then delivers to Amazon S3.
The Amazon Kinesis Agent can collect logs from various on-premises sources. Kinesis Firehose is a fully managed service that can reliably ingest high volumes of streaming data and automatically deliver it to Amazon S3 for cost-effective, long-term archiving and occasional analysis, minimizing operational overhead.
Why the other options are wrong
- B. AWS DataSync is primarily for large-scale, one-time or periodic data transfers, not real-time streaming log ingestion from various sources.
- C. Fluentd can send logs, but sending to CloudWatch Logs directly for *long-term archiving* can be more expensive than S3, and CloudWatch Logs is more suited for real-time monitoring than bulk archiving.
- D. Storage Gateway File Gateway provides file-based access to S3, but it's more for hybrid cloud storage use cases than for real-time, high-volume log ingestion from diverse application/OS sources.
On-Prem Log Ingestion to S3
A cost-effective, low-overhead solution to collect and centralize application and OS logs from on-premises environments into Amazon S3 for long-term storage and analysis.
- Kinesis Agent for on-premises log collection.
- Kinesis Firehose for managed, scalable ingestion.
- Amazon S3 for cost-effective, long-term archiving.
Memory trick: Agent gathers on-prem logs, Firehose streams them to S3 for safe keeping.