From the source
We have developed a platform that lets anyone customize models, previewed an AI system built for interactive collaboration, and published novel research .
Today we are advancing our mission by releasing a model we trained from scratch with the full weights available, so that people can make it their own.
Our model, called Inkling, is a Mixture-of-Experts transformer with 975B total parameters, 41B active.
It supports a context window of up to 1M tokens.
It was pretrained on 45 trillion tokens of text, images, audio and video.
It is the first in a family of models of different sizes: alongside it we are sharing a preview of Inkling-Small, a lighter-weight model with 12B active parameters, trained with a similar recipe, that achieves strong performance with even lower cost and latency.
Inkling reasons natively over text, images, and audio, and balances cost with performance through efficient and controllable thinking effort.
We trained it to be a broad, balanced foundation model: strong across many domains, flexible enough to adapt.
Inkling is not the strongest overall model available today, open or closed.
…
