# Hugging Face — Optimize and deploy with Optimum-Intel and OpenVINO GenAI

- Company: Hugging Face (huggingface.co)
- Announced: 2024-09-20T00:00:00+00:00
- Subject: Platform
- Source: https://huggingface.co/blog/deploy-with-openvino
- Record: https://forck.live/items/1828-optimize-and-deploy-with-optimum-intel-and-openvino-genai

This blog post provides a step-by-step guide on optimizing and deploying Hugging Face Transformers models using Optimum-Intel and OpenVINO GenAI, focusing on edge and client-side deployment with C++ and Python. It covers environment setup, exporting models to OpenVINO IR, weight-only quantization (including INT4/INT8 with AWQ and scale estimation), and deployment using the OpenVINO GenAI API.

## Evidence

Verbatim from https://huggingface.co/blog/deploy-with-openvino:

> This blog will guide you through optimizing and deploying Hugging Face Transformers models using Optimum-Intel and OpenVINO™ GenAI, ensuring efficient AI inference with minimal dependencies.

---

Record: https://forck.live/items/1828-optimize-and-deploy-with-optimum-intel-and-openvino-genai
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md