# Hugging Face — Overview of natively supported quantization schemes in 🤗 Transformers

- Company: Hugging Face (huggingface.co)
- Announced: 2023-09-12
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://huggingface.co/blog/overview-quantization-transformers
- Record: https://forck.live/items/1999-overview-of-natively-supported-quantization-schemes-in-transformers
- Subject: Platform

Hugging Face published a blog post comparing the bitsandbytes and auto-gptq quantization schemes supported natively in Transformers, discussing their benefits and drawbacks.

## Evidence

Verbatim from https://huggingface.co/blog/overview-quantization-transformers:

> We aim to give a clear overview of the pros and cons of each quantization scheme supported in transformers to help you decide which one you should go for.

---

Record: https://forck.live/items/1999-overview-of-natively-supported-quantization-schemes-in-transformers
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md