# Hugging Face — Benchmarking Text Generation Inference

- Company: Hugging Face (huggingface.co)
- Announced: 2024-05-29T00:00:00+00:00
- Category: developer-tool-release
- Subject: Platform
- Source: https://huggingface.co/blog/tgi-benchmarking
- Record: https://forck.live/items/1880-benchmarking-text-generation-inference

Hugging Face introduces the TGI Benchmarking tool, a tool to profile Text Generation Inference deployments beyond simple throughput.

## Evidence

Verbatim from https://huggingface.co/blog/tgi-benchmarking:

> In this blog we will be exploring Text Generation Inference’s (TGI) little brother, the TGI Benchmarking tool.

---

Record: https://forck.live/items/1880-benchmarking-text-generation-inference
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md