Accelerating Hugging Face Transformers with AWS Inferentia2
Hugging Face announces a partnership with AWS to optimize Hugging Face Transformers for the new AWS Inferentia2 inference accelerator, which delivers significant improvements in throughput, latency, and performance per watt compared to previous generations and GPUs.