🚀 Accelerating LLM Inference with TGI on Intel Gaudi

Hugging Face announces native integration of Intel Gaudi hardware support into Text Generation Inference (TGI), enabling deployment of LLMs on Gaudi accelerators with features like multi-card inference, vision-language models, and FP8 precision, and supporting models such as Llama 3.1, Mixtral, Mistral, and more.