# Hugging Face — Unlocking asynchronicity in continuous batching

- Company: Hugging Face (huggingface.co)
- Announced: 2026-05-14T00:00:00+00:00
- Subject: Platform
- Source: https://huggingface.co/blog/continuous_async
- Record: https://forck.live/items/1504-unlocking-asynchronicity-in-continuous-batching

Hugging Face published a blog post explaining asynchronous batching for continuous batching in LLM inference, which separates CPU and GPU workloads to improve GPU utilization, and has been implemented in the transformers library.

## Evidence

Verbatim from https://huggingface.co/blog/continuous_async:

> we explain how to separate CPU and GPU workloads to get a massive performance boost for inference.

---

Record: https://forck.live/items/1504-unlocking-asynchronicity-in-continuous-batching
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md