🟢

Amazon FSx for Lustre

  • Fully managed parallel distributed file system for high-performance computing.
  • Name derives from Linux + Cluster.
  • Ideal for workloads requiring massive throughput and low latency.

Use Cases

  • Machine Learning training pipelines.
  • HPC (High Performance Computing) simulations.
  • Video rendering and processing.
  • Financial modeling, electronic design automation.

Performance & Storage

  • Scales to hundreds of GB/s throughput, millions of IOPS, and sub-millisecond latency.
  • SSD – Low-latency, IOPS-heavy, small/random file access.
  • HDD – High-throughput, large/sequential file operations.

S3 Integration

  • Can mount S3 data as a file system.
  • Can write computation results back to S3.
  • Accessible from on-premises via VPN or Direct Connect.

Deployment Options

  • Scratch:
    • Temporary, non-replicated storage.
    • Very high burst performance (up to 200 MB/s per TiB).
    • Use for short-term or disposable workloads.
  • Persistent:
    • Long-term storage, replicated within the same AZ.
    • Automatic recovery from hardware failures.
    • Use for sensitive or long-lived workloads.