# Hugging Face — From DeepSpeed to FSDP and Back Again with Hugging Face Accelerate

- Company: Hugging Face (huggingface.co)
- Announced: 2024-06-13T00:00:00+00:00
- Category: capability-change
- Subject: Platform
- Source: https://huggingface.co/blog/deepspeed-to-fsdp-and-back
- Record: https://forck.live/items/1871-from-deepspeed-to-fsdp-and-back-again-with-hugging-face-accelerate

Hugging Face Accelerate introduces a precision-related change and a concept guide to harmonize FSDP and DeepSpeed backends, enabling users to seamlessly switch between them. The change, included in the 0.30.0 release, allows FSDP to operate in a mixed-precision mode similar to DeepSpeed or a low-precision mode for memory-constrained scenarios.

## Evidence

Verbatim from https://huggingface.co/blog/deepspeed-to-fsdp-and-back:

> To enable users to seamlessly switch between these backends, we upstreamed a precision-related change and a concept guide.

---

Record: https://forck.live/items/1871-from-deepspeed-to-fsdp-and-back-again-with-hugging-face-accelerate
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md