# TII — Welcome to the Falcon 3 Family of Open Models!

- Company: TII (tii.ae)
- Announced: 2024-12-17T12:00:00+00:00
- Category: open-weight-release
- Coverage: not counted
- Announcement: yes
- Group: models
- Source: https://falcon-lm.github.io/blog/falcon-3/
- Record: https://forck.live/items/18417-welcome-to-the-falcon-3-family-of-open-models
- Subject: Falcon LLM
- Open weights: yes
- Models affected: Falcon3-1B-Base, Falcon3-3B-Base, Falcon3-7B-Base, Falcon3-10B-Base, Falcon3-Mamba-7B-Base
- Context window: 32k tokens (1B: 8k)

TII released Falcon3, a family of five decoder-only open-weight LLMs under 10B parameters. The models include transformer-based variants (1B, 3B, 7B, 10B) and a Mamba-based 7B variant, all supporting up to 32k context length (1B: 8k). Falcon3-10B-Base achieves state-of-the-art zero-shot and few-shot performance among models under 13B parameters, and the instruct versions outperform all instruct models under 13B on the open leaderboard.

## Evidence

Verbatim from https://falcon-lm.github.io/blog/falcon-3/:

> We introduce Falcon3, a family of decoder-only large language models under 10 billion parameters, developed by Technology Innovation Institute (TII) in Abu Dhabi.

---

Record: https://forck.live/items/18417-welcome-to-the-falcon-3-family-of-open-models
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md