# Hugging Face — Towards Encrypted Large Language Models with FHE

- Company: Hugging Face (huggingface.co)
- Announced: 2023-08-02
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://huggingface.co/blog/encrypted-llm
- Record: https://forck.live/items/2017-towards-encrypted-large-language-models-with-fhe
- Subject: Platform
- Models affected: GPT2

Zama demonstrates how to use Fully Homomorphic Encryption (FHE) to run parts of a GPT2 model on encrypted data, protecting both user privacy and model intellectual property, by adapting the Hugging Face transformers library with quantized operators.

## Evidence

Verbatim from https://huggingface.co/blog/encrypted-llm:

> Zama believes you can get the best of both worlds: our ambition is to protect both the privacy of the user and the IP of the model. In this blog, you’ll see how to leverage the Hugging Face transformers library and have parts of these models run on encrypted data.

---

Record: https://forck.live/items/2017-towards-encrypted-large-language-models-with-fhe
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md