Lead story
Models & availability
Latest
Lead story
Models & availability
Latest
xAI released the base model weights and network architecture of Grok-1, a 314 billion parameter Mixture-of-Experts model, under the Apache 2.0 license. The model is the raw checkpoint from pre-training in October 2023 and is not fine-tuned for any specific application.
From the source
We are releasing the weights and architecture of our 314 billion parameter Mixture-of-Experts model Grok-1.
x.ai