Hugging Face· PlatformInfrastructure

Hugging Face on AMD Instinct MI300 GPU

Hugging Face announces first-class integration of AMD Instinct MI300 GPU servers into the Hugging Face Platform, enabling seamless deployment of AI models on AMD hardware without code changes. The collaboration includes CI/CD testing on MI300 GPUs for Transformers and text-generation-inference, and performance optimizations for inference workloads using techniques like Flash Attention v2, Paged Attention, GPTQ/AWQ compression, and AMD's TunableOp.

From the source

Today we are delighted to announce that Hugging Face and AMD have been hard at work together to enable the latest generation of AMD GPU servers, namely AMD Instinct MI300, to have first-class citizen integration in the overall Hugging Face Platform.

huggingface.co

Announced

21 May 2024 00:00 UTC

Detected