From the source
Mistral AI released Mistral 7B, a 7.3B parameter language model that outperforms Llama 2 13B on all benchmarks and is released under the Apache 2.0 license.
The model uses grouped-query attention and sliding window attention for efficient inference.
They also provide a fine-tuned chat version, Mistral 7B Instruct, which outperforms Llama 2 13B chat.
