Upstage's Solar 10.7B Emerges as World's Top Pre-trained LLM

Upstage announced that its Solar 10.7B large language model achieved the top position on the Hugging Face Open LLM Leaderboard with an average score of 74.2, surpassing models including GPT-3.5 Turbo, Llama 2, Qwen 72B, and Mixtral 8x7B.

The model is pre-trained on over three trillion tokens using a depth up-scaling technique based on open-source 7B models.

Solar 10.7B is available as an open-source LLM under the Apache 2.0 license.