From the source
Hugging Face announces the first release candidate for Accelerate 1.0.0, a library for simplifying multi-GPU and TPU training in PyTorch, with new features like FP8 support, DeepSpeed multi-model orchestration, and torch.compile integration.






