# Hugging Face — Assisted Generation: a new direction toward low-latency text generation

- Company: Hugging Face (huggingface.co)
- Announced: 2023-05-11
- Category: research-paper
- Coverage: not counted
- Announcement: yes
- Group: announcements
- Source: https://huggingface.co/blog/assisted-generation
- Record: https://forck.live/items/2064-assisted-generation-a-new-direction-toward-low-latency-text-generation
- Subject: Platform

Hugging Face introduces assisted generation, a new decoding method that reduces latency for autoregressive text generation by up to 10x on commodity hardware.

## Evidence

Verbatim from https://huggingface.co/blog/assisted-generation:

> by using our new method, assisted generation, you can reduce latency up to 10x in commodity hardware!

---

Record: https://forck.live/items/2064-assisted-generation-a-new-direction-toward-low-latency-text-generation
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md