# Upstage — Introducing Solar Mini: Compact yet Powerful

- Company: Upstage (upstage.ai)
- Announced: 2024-01-25
- Category: new-model
- Coverage: not counted
- Announcement: yes
- Group: models
- Source: https://www.upstage.ai/blog/en/introducing-solar-mini-compact-yet-powerful
- Record: https://forck.live/items/18487-introducing-solar-mini-compact-yet-powerful
- Subject: Solar Pro / Solar Mini
- Open weights: yes
- Models affected: Solar Mini, Llama 2, Mistral 7B
- License: Apache 2.0

Upstage introduced Solar Mini, a pre-trained LLM that reached the top of the Hugging Face Open LLM Leaderboard in December 2023. The model uses fewer parameters than GPT-3.5 but is 2.5 times faster, and is built using a depth up-scaling method on a 32-layer Llama 2 architecture initialized with Mistral 7B weights. Solar Mini is publicly available under the Apache 2.0 license.

## Evidence

Verbatim from https://www.upstage.ai/blog/en/introducing-solar-mini-compact-yet-powerful:

> In December 2023, Solar Mini made waves by reaching the pinnacle of the Open LLM Leaderboard of Hugging Face. Using notably fewer parameters, Solar Mini delivers responses comparable to GPT-3.5, but is 2.5 times faster.

---

Record: https://forck.live/items/18487-introducing-solar-mini-compact-yet-powerful
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md