Lead story
Models & availability
Latest
Lead story
Models & availability
Latest
Intel introduces AutoRound, a new quantization tool for LLMs and VLMs that uses signed gradient descent to optimize weight rounding and clipping, supporting low-bit quantization with minimal accuracy loss.
From the source
AutoRound is a weight-only post-training quantization (PTQ) method developed by Intel.
huggingface.co