# Hugging Face — Hugging Face on AMD Instinct MI300 GPU

- Company: Hugging Face (huggingface.co)
- Announced: 2024-05-21T00:00:00+00:00
- Category: infrastructure-release
- Subject: Platform
- Source: https://huggingface.co/blog/huggingface-amd-mi300
- Record: https://forck.live/items/1887-hugging-face-on-amd-instinct-mi300-gpu

Hugging Face announces first-class integration of AMD Instinct MI300 GPU servers into the Hugging Face Platform, enabling seamless deployment of AI models on AMD hardware without code changes. The collaboration includes CI/CD testing on MI300 GPUs for Transformers and text-generation-inference, and performance optimizations for inference workloads using techniques like Flash Attention v2, Paged Attention, GPTQ/AWQ compression, and AMD's TunableOp.

## Evidence

Verbatim from https://huggingface.co/blog/huggingface-amd-mi300:

> Today we are delighted to announce that Hugging Face and AMD have been hard at work together to enable the latest generation of AMD GPU servers, namely AMD Instinct MI300, to have first-class citizen integration in the overall Hugging Face Platform.

---

Record: https://forck.live/items/1887-hugging-face-on-amd-instinct-mi300-gpu
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md