# Hugging Face — WWDC 24: Running Mistral 7B with Core ML

- Company: Hugging Face (huggingface.co)
- Announced: 2024-07-22T00:00:00+00:00
- Subject: Platform
- Models affected: Mistral 7B
- Source: https://huggingface.co/blog/mistral-coreml
- Record: https://forck.live/items/1850-wwdc-24-running-mistral-7b-with-core-ml

Hugging Face published a blog post detailing how to run Mistral 7B with Core ML on a Mac, using new features from WWDC 24 such as Swift Tensor and Stateful Buffers, and achieving less than 4GB memory usage.

## Evidence

Verbatim from https://huggingface.co/blog/mistral-coreml:

> By the end of this blog post, you will have learnt all the new goodies accompanying the latest macOS release AND you will have successfully run a 7B parameter model using less than 4GB of memory on your Mac.

---

Record: https://forck.live/items/1850-wwdc-24-running-mistral-7b-with-core-ml
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md