From the source
TII released Falcon3, a family of five decoder-only open-weight LLMs under 10B parameters.
The models include transformer-based variants (1B, 3B, 7B, 10B) and a Mamba-based 7B variant, all supporting up to 32k context length (1B: 8k).
Falcon3-10B-Base achieves state-of-the-art zero-shot and few-shot performance among models under 13B parameters, and the instruct versions outperform all instruct models under 13B on the open leaderboard.
