From the source
A causal, multimodal system that learns to predict the world Oliver Cameron December 20th, 2025 A New Form of Multimodal Intelligence We now know that simple, causal prediction objectives give rise to surprisingly general intelligence.
In language, predicting the next token forces models to internalize syntax, semantics, and long-range structure.
We now see this approach extend beyond language to world models, resulting in nascent world simulators.
A world simulator—like Odyssey-2 Pro —is a model capable of predicting how the world evolves over time, learned from trillions of observations of the world found in video and interaction data.
Rather than relying on hand-crafted rules, it learns the laws of the world directly from data.
We believe this will soon unlock systems that internalize physics, human behavior, and cause-and-effect at an unprecedented scale, revolutionizing robotics, science, healthcare, education, gaming, and beyond.
Odyssey-2 Pro, a nascent world simulator Learning the World Through Observation Why do we care about next-state prediction or next-token prediction as pretraining tasks?
…
