# Hugging Face — Prefill and Decode for Concurrent Requests - Optimizing LLM Performance

- Company: Hugging Face (huggingface.co)
- Announced: 2025-04-16T10:10:58+00:00
- Subject: Platform
- Source: https://huggingface.co/blog/tngtech/llm-performance-prefill-decode-concurrent-requests
- Record: https://forck.live/items/1709-prefill-and-decode-for-concurrent-requests-optimizing-llm-performance

The article discusses the impact of concurrent request processing on LLM latency, throughput, and GPU utilization, focusing on the prefill and decode phases.

## Evidence

Verbatim from https://huggingface.co/blog/tngtech/llm-performance-prefill-decode-concurrent-requests:

> In this second part, we will now focus on the concurrent processing of requests, and how it impacts relevant metrics such as latency and throughput as well as GPU resource utilization.

---

Record: https://forck.live/items/1709-prefill-and-decode-for-concurrent-requests-optimizing-llm-performance
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md