# Hugging Face — Welcome Falcon Mamba: The first strong attention-free 7B model

- Company: Hugging Face (huggingface.co)
- Announced: 2024-08-12T00:00:00+00:00
- Category: new-model
- Subject: Platform
- Models affected: Falcon Mamba-7B
- License: TII Falcon Mamba 7B License 1.0
- Source: https://huggingface.co/blog/falconmamba
- Record: https://forck.live/items/1840-welcome-falcon-mamba-the-first-strong-attention-free-7b-model

Falcon Mamba is a new 7B parameter model by TII, based on the Mamba architecture without attention, released under a custom license. It is open access and available on Hugging Face. It achieves competitive performance on various benchmarks and offers efficient processing of long sequences.

## Evidence

Verbatim from https://huggingface.co/blog/falconmamba:

> Falcon Mamba is a new model by Technology Innovation Institute (TII) in Abu Dhabi released under the TII Falcon Mamba 7B License 1.0.

---

Record: https://forck.live/items/1840-welcome-falcon-mamba-the-first-strong-attention-free-7b-model
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md