Ling: A MoE LLM Provided and Open-sourced by InclusionAI

InclusionAI open-sourced Ling, a mixture-of-experts large language model, in two sizes: Ling-lite (16.8B total, 2.75B activated parameters) and Ling-plus (290B total, 28.8B activated parameters).

The models are available on Hugging Face and ModelScope.

A subsequent update released Ling-lite-1.5 with improved reasoning, and Ling-lite-0415 with improvements in code and math over the earlier Ling-lite-0220.