# Hugging Face — Faster assisted generation support for Intel Gaudi

- Company: Hugging Face (huggingface.co)
- Announced: 2024-06-04T00:00:00+00:00
- Category: capability-change
- Subject: Platform
- Source: https://huggingface.co/blog/assisted-generation-support-gaudi
- Record: https://forck.live/items/1878-faster-assisted-generation-support-for-intel-gaudi

Hugging Face and Intel have adapted and optimized assisted decoding (speculative sampling) for Intel Gaudi processors, now integrated into Optimum Habana to accelerate text generation.

## Evidence

Verbatim from https://huggingface.co/blog/assisted-generation-support-gaudi:

> We adapted and optimized it for Intel Gaudi, which delivers similar performance as Nvidia H100 GPUs as shown in a previous post, while its price is in the same ballpark as Nvidia A100 80GB GPUs. This work is now part of Optimum Habana, which extends various Hugging Face libraries like Transformers and Diffusers so that your AI workflows are fully optimized for Intel Gaudi processors.

---

Record: https://forck.live/items/1878-faster-assisted-generation-support-for-intel-gaudi
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md