Lead story
Models & availability
Latest
Lead story
Models & availability
Latest
Hugging Face introduces the TGI Benchmarking tool, a tool to profile Text Generation Inference deployments beyond simple throughput.
From the source
In this blog we will be exploring Text Generation Inference’s (TGI) little brother, the TGI Benchmarking tool.
huggingface.co