From the source
Hugging Face introduced 🤗 Accelerate, a library that allows PyTorch users to run training scripts on any device with minimal code changes, supporting distributed training, mixed precision, and various hardware setups.
From the source
🤗 Accelerate was created for PyTorch users who like to have full control over their training loops but are reluctant to write (and maintain) the boilerplate code needed to use distributed training (for multi-GPU on one or several nodes, TPUs, ...) or mixed precision training.
huggingface.co
