Hugging Face· PlatformAvailability change

Hugging Face Text Generation Inference available for AWS Inferentia2

Hugging Face announces general availability of Text Generation Inference (TGI) on AWS Inferentia2 and Amazon SageMaker, enabling deployment of open LLMs like Zephyr 7B on AWS Inferentia2.

From the source

We are excited to announce the general availability of Hugging Face Text Generation Inference (TGI) on AWS Inferentia2 and Amazon SageMaker.

huggingface.co

Announced

01 Feb 2024 00:00 UTC

Detected

03 Aug 2026 21:12 UTC (+914d after)

License

Apache 2.0