A Deepdive into Aya Expanse: Advancing the Frontier of Multilinguality
New model
Cohere For AI releases the Aya Expanse family of multilingual models (8B and 32B parameters) as open weights, claiming state-of-the-art multilingual performance that outperforms larger models like Llama 3.1 70B and rivals in its class.
The blog details technical innovations including data arbitrage, multilingual preference training, safety tuning, and model merging.
