# Mistral AI — Mixtral of experts

- Company: Mistral AI (mistral.ai)
- Announced: 2023-12-11T07:00:00+00:00
- Category: open-weight-release
- Coverage: not counted
- Announcement: yes
- Group: models
- Source: https://mistral.ai/news/mixtral-of-experts/
- Record: https://forck.live/items/7377-mixtral-of-experts
- Subject: Mistral / Le Chat
- Open weights: yes
- Models affected: Mixtral 8x7B, Mixtral 8x7B Instruct
- License: Apache 2.0
- Context window: 32k tokens

Mistral AI released Mixtral 8x7B, an open-weight sparse mixture of experts model under Apache 2.0 license. The model outperforms Llama 2 70B on most benchmarks and matches GPT3.5, with a 32k token context and multilingual support. An instruction-tuned variant, Mixtral 8x7B Instruct, was also released.

## Evidence

Verbatim from https://mistral.ai/news/mixtral-of-experts/:

> Today, the team is proud to release Mixtral 8x7B, a high-quality sparse mixture of experts model (SMoE) with open weights. Licensed under Apache 2.0. Mixtral outperforms Llama 2 70B on most benchmarks with 6x faster inference.

---

Record: https://forck.live/items/7377-mixtral-of-experts
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md