From the source
Hugging Face and Microsoft's ONNX Runtime announce the integration of ONNX Runtime training support into the Optimum library, enabling up to 130% training speedup (with DeepSpeed ZeRO Stage 1) for popular Hugging Face Transformer models.
The ORTTrainer API simplifies adoption with ease-of-use similar to the Transformers Trainer.





