# Ai2 — Modular LLMs at scale: how FlexOlmo is helping to pool national expertise without pooling sensitive data

- Company: Ai2 (allenai.org)
- Announced: 2026-07-02
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://allenai.org/blog/flexmore
- Record: https://forck.live/items/18547-modular-llms-at-scale-how-flexolmo-is-helping-to-pool-national-expertise
- Subject: Olmo / Molmo / Asta

Researchers at the University of Southern Denmark's OdenseNLP lab built FlexMoRE, a modification of Ai2's FlexOlmo architecture that replaces most full-size experts with smaller low-rank adapters. FlexMoRE outperforms a FlexOlmo-style baseline while using less than one-third the parameters, enabling modular language models to run on consumer hardware. The work is part of the Danish Foundation Models (DFM) project, which aims to develop open Danish-language models for institutions that cannot share sensitive data.

## Evidence

Verbatim from https://allenai.org/blog/flexmore:

> In its best configuration, FlexMoRE outperforms a FlexOlmo-style baseline of full-size experts while using less than one-third the parameters.

---

Record: https://forck.live/items/18547-modular-llms-at-scale-how-flexolmo-is-helping-to-pool-national-expertise
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md