Blazing Fast SetFit Inference with 🤗 Optimum Intel on Xeon
Developer tool
Hugging Face and Intel announce that SetFit inference can be accelerated by 7.8x on Intel CPUs using Optimum Intel, an open-source library that includes post-training static quantization to convert models to INT8 precision, enabling production-grade deployment on Intel Xeon CPUs.
