From the source
xAI released the base model weights and network architecture of Grok-1, a 314 billion parameter Mixture-of-Experts model, under the Apache 2.0 license.
The model is the raw checkpoint from pre-training in October 2023 and is not fine-tuned for any specific application.
