From the source
Mistral AI released Mixtral 8x7B, an open-weight sparse mixture of experts model under Apache 2.0 license.
The model outperforms Llama 2 70B on most benchmarks and matches GPT3.5, with a 32k token context and multilingual support.
An instruction-tuned variant, Mixtral 8x7B Instruct, was also released.
