From the source
It achieves 56.6% on MATH and 63.47% on MMLU benchmarks.
The weights are hosted on HuggingFace for use and fine-tuning.
MathΣtral
Mistral AI released Mathstral, a model specialized in STEM reasoning, built on Mistral 7B.
New model
From the source
Mathstral achieves state-of-the-art reasoning capacities in its size category across various industry-standard benchmarks. In particular, it achieves 56.6% on MATH and 63.47% on MMLU, with the following MMLU performance difference by subject between Mathstral 7B and Mistral 7B.
mistral.ai
