Google DeepMind Rolls Out Genie 4 World Model in Research Preview
Natively multimodal world model generates audio and dialogue in real time
New model
Google DeepMind announced Genie 4, a natively multimodal world model for real-time interactive simulation, on October 27, 2026, releasing it as a research preview to trusted testers.
DeepMind says the model "unlocks unprecedented realism and improves real-time interactive simulation," generating music, ambient noises and interactive dialogue alongside the simulated world.
It builds on the Gemini family: Gemini Omni anchors simulations in real-world appearance and behavior, while other Gemini models supply the reasoning that keeps a simulation coherent.
Users steer running worlds with standard keyboard controls and text prompts, changing weather, moving the camera or introducing people and objects, and Gemini adapts each prompt to the surrounding scene.
DeepMind describes Genie 4 as its first real-time world model to generate audio natively, with each world carrying its own ambient sound and characters conversing in real time.
For multi-step events, Gemini 3.8 Flash acts as a guiding agent that breaks goals into steps and checks incoming frames to verify each one succeeded.
DeepMind says Genie 4 includes strict safety guardrails and internal safety evaluations, and that all generated video and audio will carry SynthID watermarking.
From the source
Google DeepMind announced Genie 4 , its new world model for real-time interactive simulation, on October 27, 2026, releasing it as a research preview to trusted testers.
The announcement, authored by Raia Hadsell, Diego Rivas and Hang Qi, describes Genie 4 as natively multimodal, with music, ambient noises and interactive dialogue generated simultaneously alongside the simulated world. DeepMind says the model “unlocks unprecedented realism and improves real-time interactive simulation,” and delivers enhanced photorealism, fluid movement and native audio, with the accompanying sound in its demonstrations produced directly by the model.
The model incorporates and builds on capabilities from the Gemini family. Gemini Omni anchors the simulations in real-world appearance and behavior, while other Gemini models provide the complex reasoning needed to help maintain a simulation’s coherence and continuity.
With that foundation, a user can set an event in motion and Genie 4 simulates what happens next: how the world responds, how it sounds, and how the people in it move, react and speak.
DeepMind describes understanding and simulating the world as a crucial aspect of building AGI.