# Upstage — Upstage's Solar 10.7B Emerges as World's Top Pre-trained LLM

- Company: Upstage (upstage.ai)
- Announced: 2023-12-14
- Category: new-model
- Coverage: not counted
- Announcement: yes
- Group: models
- Source: https://www.upstage.ai/news/solar-10-7b-emerges-as-worlds-top-pre-trained-llm
- Record: https://forck.live/items/18450-upstage-s-solar-10-7b-emerges-as-world-s-top-pre-trained-llm
- Subject: Solar Pro / Solar Mini
- Open weights: yes
- Models affected: Solar 10.7B
- License: Apache 2.0

Upstage announced that its Solar 10.7B large language model achieved the top position on the Hugging Face Open LLM Leaderboard with an average score of 74.2, surpassing models including GPT-3.5 Turbo, Llama 2, Qwen 72B, and Mixtral 8x7B. The model is pre-trained on over three trillion tokens using a depth up-scaling technique based on open-source 7B models. Solar 10.7B is available as an open-source LLM under the Apache 2.0 license.

## Evidence

Verbatim from https://www.upstage.ai/news/solar-10-7b-emerges-as-worlds-top-pre-trained-llm:

> Solar 10.7B surpassed all models on the Open LLM Leaderboard, with an average score of 74.2.

---

Record: https://forck.live/items/18450-upstage-s-solar-10-7b-emerges-as-world-s-top-pre-trained-llm
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md