# Hugging Face — Training mRNA Language Models Across 25 Species for $165

- Company: Hugging Face (huggingface.co)
- Announced: 2026-03-31T08:23:44+00:00
- Category: new-model
- Subject: Platform
- Models affected: CodonRoBERTa-large-v2, CodonRoBERTa-large, CodonRoBERTa-base, ModernBERT-base, CodonBERT
- Source: https://huggingface.co/blog/OpenMed/training-mrna-models-25-species
- Record: https://forck.live/items/1528-training-mrna-language-models-across-25-species-for-165

OpenMed built an end-to-end protein AI pipeline covering structure prediction, sequence design, and codon optimization. They trained and compared multiple transformer architectures for codon-level language modeling, finding CodonRoBERTa-large-v2 as the best with perplexity 4.10 and Spearman CAI correlation 0.40. They scaled to 25 species, training 4 production models in 55 GPU-hours, and built a species-conditioned system that no other open-source project offers.

## Evidence

Verbatim from https://huggingface.co/blog/OpenMed/training-mrna-models-25-species:

> CodonRoBERTa-large-v2 emerged as the clear winner with a perplexity of 4.10 and a Spearman CAI correlation of 0.40, significantly outperforming ModernBERT. We then scaled to 25 species, trained 4 production models in 55 GPU-hours, and built a species-conditioned system that no other open-source project offers.

---

Record: https://forck.live/items/1528-training-mrna-language-models-across-25-species-for-165
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md