Together AI· Inference platformNew model

Parcae: Doing more with fewer parameters using stable looped models

Together AI introduces Parcae, a stable looped language model architecture that achieves the quality of a Transformer with twice the parameters, using fewer parameters by increasing recurrence. A 770M parameter Parcae matches a 1.3B parameter Transformer.

From the source

We present Parcae, one of the first stable architectures for looped language models, achieving the quality of a Transformer twice the size with clean, predictable training.

together.ai

Announced

15 Apr 2026 00:00 UTC

Detected

03 Aug 2026 21:12 UTC (+110d after)