# Hugging Face — Mixture of Experts Explained

- Company: Hugging Face (huggingface.co)
- Announced: 2023-12-11
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://huggingface.co/blog/moe
- Record: https://forck.live/items/1967-mixture-of-experts-explained
- Subject: Platform

Mixture of Experts (MoE) models, their history, training, and tradeoffs.

## Evidence

Verbatim from https://huggingface.co/blog/moe:

> In this blog post, we take a look at the building blocks of MoEs, how they’re trained, and the tradeoffs to consider when serving them for inference.

---

Record: https://forck.live/items/1967-mixture-of-experts-explained
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md