# Hugging Face — Faster Text Generation with TensorFlow and XLA

- Company: Hugging Face (huggingface.co)
- Announced: 2022-07-27
- Category: capability-change
- Coverage: not counted
- Announcement: yes
- Group: announcements
- Source: https://huggingface.co/blog/tf-xla-generate
- Record: https://forck.live/items/2173-faster-text-generation-with-tensorflow-and-xla
- Subject: Platform
- Models affected: GPT-2, gpt2

The Hugging Face transformers library now supports XLA compilation for text generation with TensorFlow, achieving up to 100x speedup and surpassing PyTorch performance.

## Evidence

Verbatim from https://huggingface.co/blog/tf-xla-generate:

> Text Generation on 🤗 transformers using TensorFlow can now be compiled with XLA. It is up to 100x faster than before, and even faster than PyTorch

---

Record: https://forck.live/items/2173-faster-text-generation-with-tensorflow-and-xla
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md