A global research institution is migrating a legacy high-performance computing (HPC) cluster to AWS. The cluster consists of hundreds of compute nodes that require ultra-low latency, high-throughput network connectivity to shared parallel file systems for large dataset processing. The institution needs to maintain POSIX-compliant file system access and wants to minimize changes to existing applications. They also require robust data protection and backup capabilities. Which AWS service combination provides the optimal solution for the shared file system?
- AAmazon EFS mounted across EC2 instances for shared storage.
- BAmazon EBS volumes attached individually to each EC2 instance and managed with a distributed file system.
- CAWS FSx for Lustre integrated with Amazon S3 for durable, high-performance storage.
- DAmazon S3 configured with S3 File Gateway for POSIX access.
Show answer & explanationAnswer & explanation
Correct answer: C. AWS FSx for Lustre integrated with Amazon S3 for durable, high-performance storage.
AWS FSx for Lustre is specifically designed for HPC workloads, offering ultra-low latency and high-throughput POSIX-compliant file system access. Its integration with Amazon S3 provides a durable, scalable backend for large datasets and robust data protection, making it ideal for migrating a legacy HPC cluster with minimal application changes.
Why the other options are wrong
- A. Amazon EFS is a good general-purpose NFS file system, but it typically does not offer the ultra-low latency and raw throughput required for demanding HPC workloads like Lustre.
- B. Managing a distributed file system across hundreds of EBS volumes is complex, introduces significant operational overhead, and is unlikely to match the performance or simplicity of a managed service like FSx for Lustre.
- D. S3 File Gateway provides NFS/SMB access to S3, but it's primarily for hybrid cloud storage and backup, not for the ultra-low latency and high-throughput requirements of an active HPC parallel file system.
AWS FSx for Lustre
AWS FSx for Lustre is a fully managed file system that is optimized for compute-intensive workloads, such as high-performance computing (HPC), machine learning, and media processing. It provides high-performance, POSIX-compliant file storage that integrates with Amazon S3.
- Optimized for HPC workloads (ultra-low latency, high throughput)
- POSIX-compliant file system
- Integrates with Amazon S3 for durable data storage
- Fully managed service, reduces operational overhead
Memory trick: FSx for Lustre: Your HPC's lightning-fast file system.