# Hugging Face — Welcome Inkling 2 Mini, Cutting-edge Performance for your Local Setup

- Company: Hugging Face (huggingface.co)
- Announced: 2026-11-20
- Category: new-model
- Coverage: not counted
- Announcement: yes
- Group: models
- Source: https://huggingface.co/blog/inkling2mini
- Record: https://forck.live/items/39405-welcome-inkling-2-mini-cutting-edge-performance-for-your-local-setup
- Subject: Platform
- Open weights: yes
- Models affected: Inkling 2 Mini, TML-d24-varloop-research
- Context window: 1M-token context size

Thinking Machines Lab has released Inkling 2 Mini, a looped-transformer multimodal Mixture-of-Experts model built for local AI setups, with about 26B physical and 3B active parameters per token. The model has 24 decoder layers, but its 12 middle layers run three times in a loop, so it behaves like 48 logical layers while storing only 24 physical ones. It supports a 1M-token context and accepts images and text, and ships in a mixed-precision format with NVFP4 and MXFP8 expert weights plus a DSpark drafter for extra speed at a small memory cost. Hugging Face says the model is state-of-the-art in its class on the Artificial Analysis Intelligence Index v5 and leads in 32 of 48 benchmarks against Gemma 4 31B, Muse Glimmer, Qwen3.8-27B and Nemotron 3.5 Super VL. In vibe tests it was at least comparable with Qwen 3.8 27B, though the post says more validation is needed. Transformers, llama.cpp and MLX support are provided, and SGLang offers day-zero inference support for production deployments on datacenter hardware. A separate research artifact, TML-d24-varloop-research, shares the architecture but accepts a variable number of loop passes; setting 1 or 2 passes instead of 3 speeds inference considerably, with possibly slightly lower quality.

## Evidence

Verbatim from https://huggingface.co/blog/inkling2mini:

> TLDR; Inkling 2 Mini is a new looped transformer model. It’s a multimodal Mixture-of-Experts with ~26B physical total and 3B active parameters per token. It uses a neat trick to increase capacity: some layers are visited in a loop that repeats three times, which makes it work like it had more parameters. It supports a 1M-token context size, accepts images and text inputs. Thinking Machines Lab ships the model in a mixed-precision format, with NVFP4 and MXFP8 expert weights. A DSpark drafter is also included for additional speed-up at a small memory cost.
> 
> Inkling 2 Mini is much, much smaller than Inkling 2 Small, and is designed for local AI setups. We think this is a refreshingly new great local model. In our vibe tests, it's at least comparable with Qwen 3.8 27B. More validation is needed, but we are super excited about this release!
> 
> We ship transformers, Llama App (llama.cpp), and MLX support. SGLang also provides day-zero inference support for production deployments on datacenter hardware.
> 
> This post goes through what makes Inkling Mini different, some of our vibe tests, and how you can use it with your setup.
> 
> What is new with Inkling 2 Mini?

---

Record: https://forck.live/items/39405-welcome-inkling-2-mini-cutting-edge-performance-for-your-local-setup
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md
