# Hugging Face — Optimum+ONNX Runtime - Easier, Faster training for your Hugging Face models

- Company: Hugging Face (huggingface.co)
- Announced: 2023-01-24
- Category: developer-tool-release
- Coverage: not counted
- Announcement: yes
- Group: announcements
- Source: https://huggingface.co/blog/optimum-onnxruntime-training
- Record: https://forck.live/items/2108-optimum-onnx-runtime-easier-faster-training-for-your-hugging-face-models
- Subject: Platform

Hugging Face and Microsoft's ONNX Runtime announce the integration of ONNX Runtime training support into the Optimum library, enabling up to 130% training speedup (with DeepSpeed ZeRO Stage 1) for popular Hugging Face Transformer models. The ORTTrainer API simplifies adoption with ease-of-use similar to the Transformers Trainer.

## Evidence

Verbatim from https://huggingface.co/blog/optimum-onnxruntime-training:

> improve training times by 35% or more … from 39% to 130% … ONNX Runtime Training achieves such throughput improvements via several memory and compute optimizations.

---

Record: https://forck.live/items/2108-optimum-onnx-runtime-easier-faster-training-for-your-hugging-face-models
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md