AWS Certified DevOps Engineer – ProfessionalIncident and Event ResponseMedium

A media company uses Amazon S3 to store large volumes of user-uploaded content. They need to implement an automated workflow to ensure that newly uploaded video files are immediately transcoded into multiple formats for different device compatibility. This process should be highly available, scalable, and cost-effective. Which solution BEST meets these requirements?

  1. ASet up S3 Event Notifications to invoke an AWS Step Functions workflow that orchestrates a series of AWS Batch jobs for video transcoding.
  2. BConfigure S3 Event Notifications to trigger an AWS Lambda function that processes the video transcoding on the Lambda compute.
  3. CUse Amazon CloudWatch Events to detect S3 PutObject API calls, triggering an Amazon EC2 Auto Scaling group to run transcoding scripts.
  4. DImplement a cron job on a dedicated EC2 instance that periodically polls the S3 bucket for new objects and initiates transcoding.
Show answer & explanation

Correct answer: A. Set up S3 Event Notifications to invoke an AWS Step Functions workflow that orchestrates a series of AWS Batch jobs for video transcoding.

This solution leverages S3 Event Notifications for real-time detection, Step Functions for robust workflow orchestration, and AWS Batch for scalable and cost-effective processing of compute-intensive tasks like video transcoding, ensuring high availability and efficiency.

Why the other options are wrong

  • B. While S3 Event Notifications and Lambda can be used, transcoding large video files can exceed Lambda's execution limits (memory, time) and may not be cost-effective for long-running, compute-intensive tasks.
  • C. CloudWatch Events can detect API calls, but S3 Event Notifications are more direct for S3 object events. Using an EC2 Auto Scaling group directly for transcoding would require managing instances and scaling policies, which is less managed and potentially less cost-effective than AWS Batch for this workload.
  • D. A cron job polling approach is inefficient, creates latency, and lacks the real-time, event-driven, and scalable nature required for immediate processing of user-uploaded content in a highly available manner.

S3 Event-Driven Video Transcoding

Automating video transcoding by using S3 Event Notifications to trigger a workflow orchestrated by AWS Step Functions, which then uses AWS Batch for scalable and cost-effective compute.

  • S3 Event Notifications provide immediate triggers for new objects.
  • Step Functions orchestrate complex, multi-step workflows with state management.
  • AWS Batch scales compute resources efficiently for intensive tasks.
  • Ensures high availability, scalability, and cost-effectiveness for media processing.

Memory trick: S3 uploads, Step Functions orchestrates, Batch transcodes.

More Incident and Event Response questions