# Hugging Face — Blazing Fast SetFit Inference with 🤗 Optimum Intel on Xeon

- Company: Hugging Face (huggingface.co)
- Announced: 2024-04-03T00:00:00+00:00
- Category: developer-tool-release
- Subject: Platform
- Models affected: SetFit
- Source: https://huggingface.co/blog/setfit-optimum-intel
- Record: https://forck.live/items/1916-blazing-fast-setfit-inference-with-optimum-intel-on-xeon

Hugging Face and Intel announce that SetFit inference can be accelerated by 7.8x on Intel CPUs using Optimum Intel, an open-source library that includes post-training static quantization to convert models to INT8 precision, enabling production-grade deployment on Intel Xeon CPUs.

## Evidence

Verbatim from https://huggingface.co/blog/setfit-optimum-intel:

> we'll explain how you can accelerate inference with SetFit by 7.8x on Intel CPUs, by optimizing your SetFit model with 🤗 Optimum Intel

---

Record: https://forck.live/items/1916-blazing-fast-setfit-inference-with-optimum-intel-on-xeon
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md