From the source
Optimizing and deploying Hugging Face Transformers models using Optimum-Intel and OpenVINO GenAI, focusing on edge and client-side deployment with C++ and Python.
It covers environment setup, exporting models to OpenVINO IR, weight-only quantization (including INT4/INT8 with AWQ and scale estimation), and deployment using the OpenVINO GenAI API.






