Accelerating Hugging Face Transformers with AWS Inferentia2

Hugging Face announces a partnership with AWS to optimize Hugging Face Transformers for the new AWS Inferentia2 inference accelerator, which delivers significant improvements in throughput, latency, and performance per watt compared to previous generations and GPUs.