From the source
Amazon's guide demonstrates how to integrate
NVIDIA Resiliency Extension (NVRx) into PyTorch FSDP training on Amazon EKS to achieve fault-tolerant distributed training.
- It covers async checkpointing, in-process restart, and in-job restart with ft_launcher, and includes benchmark results on H100 GPUs at 2-node to 8-node scale.





