# Hugging Face — Releasing Swift Transformers: Run On-Device LLMs in Apple Devices

- Company: Hugging Face (huggingface.co)
- Announced: 2023-08-08
- Category: developer-tool-release
- Coverage: not counted
- Announcement: yes
- Group: announcements
- Source: https://huggingface.co/blog/swift-coreml-llm
- Record: https://forck.live/items/2014-releasing-swift-transformers-run-on-device-llms-in-apple-devices
- Subject: Platform
- Models affected: Llama 2 7B, Falcon 7B

Hugging Face released Swift Transformers, an in-development Swift package for text generation, along with swift-chat, updated exporters, transformers-to-coreml, and converted models (Llama 2 7B, Falcon 7B) to help developers run LLMs on Apple devices using Core ML.

## Evidence

Verbatim from https://huggingface.co/blog/swift-coreml-llm:

> Today, we are publishing this guide to go through the steps required to run a model such as Llama 2 on your Mac using Core ML. We are also releasing alpha libraries and tools to support developers in the journey.

---

Record: https://forck.live/items/2014-releasing-swift-transformers-run-on-device-llms-in-apple-devices
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md