AWS Certified Data Engineer – AssociateData Ingestion and TransformationHard
A research institution collects high-resolution satellite imagery, with individual image files often exceeding 100 GB. The data is generated in remote locations with intermittent and limited internet connectivity. These files must eventually be stored in Amazon S3 for long-term archival and processing. The solution must ensure data integrity, be physically secure during transit, and minimize reliance on unreliable network connections. Which AWS service is the MOST appropriate for ingesting this data?
- AAmazon Kinesis Data Firehose
- BAWS Transfer Family (SFTP)
- CAWS DataSync
- DAWS Snowball Edge Storage Optimized
Show answer & explanationAnswer & explanation
Correct answer: D. AWS Snowball Edge Storage Optimized
AWS Snowball Edge Storage Optimized devices are designed for transferring petabytes of data into and out of AWS, especially in environments with limited or no internet connectivity. Their rugged design ensures physical security, and they handle large files efficiently, making them ideal for high-resolution satellite imagery from remote locations.
Why the other options are wrong
- A. Amazon Kinesis Data Firehose is for real-time streaming ingestion, not for offline bulk transfer of large files.
- B. AWS Transfer Family (SFTP) requires a reliable internet connection and is more suited for ongoing file transfers, not for large bulk transfers from offline or intermittently connected environments.
- C. AWS DataSync requires a consistent network connection for online transfers, which is not available in remote locations with intermittent connectivity.
AWS Snowball Edge Storage Optimized
A ruggedized device offering significant storage and compute capabilities, designed for transferring petabytes of data to and from AWS in environments with limited or no network connectivity.
- Offline data transfer solution
- Available in Storage Optimized and Compute Optimized versions
- Supports petabyte-scale migrations
- Provides local storage and compute for edge processing
Memory trick: Snowball Edge rolls your massive data from remote areas to the cloud, even without internet.