From the source
Summary by forck
Hugging Face announces general availability of Text Generation Inference (TGI) on AWS Inferentia2 and
Amazon SageMaker, enabling deployment of open LLMs like Zephyr 7B on AWS Inferentia2.
From the source
From the source

Hugging Face announces general availability of Text Generation Inference (TGI) on AWS Inferentia2 and
Amazon SageMaker, enabling deployment of open LLMs like Zephyr 7B on AWS Inferentia2.
From the source
We are excited to announce the general availability of Hugging Face Text Generation Inference (TGI) on AWS Inferentia2 and Amazon SageMaker.
huggingface.co