# Hugging Face — A Chatbot on your Laptop: Phi-2 on Intel Meteor Lake

- Company: Hugging Face (huggingface.co)
- Announced: 2024-03-20T00:00:00+00:00
- Subject: Platform
- Models affected: Phi-2, TinyLlama
- Source: https://huggingface.co/blog/phi2-intel-meteor-lake
- Record: https://forck.live/items/1922-a-chatbot-on-your-laptop-phi-2-on-intel-meteor-lake

This blog post explains how to run the Phi-2 small language model locally on a laptop with an Intel Meteor Lake CPU by applying 4-bit quantization using Intel OpenVINO and Optimum Intel, enabling local inference with benefits like privacy, lower latency, offline work, and cost savings.

## Evidence

Verbatim from https://huggingface.co/blog/phi2-intel-meteor-lake:

> In this post, we'll leverage all of the above. Starting from the Microsoft Phi-2 model, we will apply 4-bit quantization on the model weights, thanks to the Intel OpenVINO integration in our Optimum Intel library. Then, we will run inference on a mid-range laptop powered by an Intel Meteor Lake CPU.

---

Record: https://forck.live/items/1922-a-chatbot-on-your-laptop-phi-2-on-intel-meteor-lake
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md