Introducing Solar Mini: Compact yet Powerful

Summary by forck

Upstage introduced Solar Mini, a pre-trained LLM that reached the top of the Hugging Face Open LLM Leaderboard in December 2023.

• The model uses fewer parameters than GPT-3.5 but is 2.5 times faster, and is built using a depth up-scaling method on a 32-layer Llama 2 architecture initialized with Mistral 7B weights.
• Solar Mini is publicly available under the Apache 2.0 license.