# Hugging Face — Accelerate ND-Parallel: A guide to Efficient Multi-GPU Training

- Company: Hugging Face (huggingface.co)
- Announced: 2025-08-08T00:00:00+00:00
- Category: capability-change
- Subject: Platform
- Source: https://huggingface.co/blog/accelerate-nd-parallel
- Record: https://forck.live/items/1641-accelerate-nd-parallel-a-guide-to-efficient-multi-gpu-training

Hugging Face announces integration of ND-Parallel (multi-dimensional parallelism) into Accelerate and Axolotl, allowing users to easily combine data, tensor, context, and fully sharded data parallelism strategies for efficient multi-GPU training.

## Evidence

Verbatim from https://huggingface.co/blog/accelerate-nd-parallel:

> In Accelerate, together with Axolotl, we have integrated a quick and easy way to use any combination of parallelism strategies in your training script!

---

Record: https://forck.live/items/1641-accelerate-nd-parallel-a-guide-to-efficient-multi-gpu-training
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md