# Hugging Face — Hugging Face Text Generation Inference available for AWS Inferentia2

- Company: Hugging Face (huggingface.co)
- Announced: 2024-02-01T00:00:00+00:00
- Category: availability-change
- Subject: Platform
- Open weights: yes
- Models affected: Zephyr 7B, Mistral-7B-v0.1, zephyr-7b-beta
- License: Apache 2.0
- Source: https://huggingface.co/blog/text-generation-inference-on-inferentia2
- Record: https://forck.live/items/1947-hugging-face-text-generation-inference-available-for-aws-inferentia2

Hugging Face announces general availability of Text Generation Inference (TGI) on AWS Inferentia2 and Amazon SageMaker, enabling deployment of open LLMs like Zephyr 7B on AWS Inferentia2.

## Evidence

Verbatim from https://huggingface.co/blog/text-generation-inference-on-inferentia2:

> We are excited to announce the general availability of Hugging Face Text Generation Inference (TGI) on AWS Inferentia2 and Amazon SageMaker.

---

Record: https://forck.live/items/1947-hugging-face-text-generation-inference-available-for-aws-inferentia2
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md