From the source
Baseten says it can sync delta weights to frontier models such as GLM-5.3 across global, independent clusters in under 40 seconds, with only 6 seconds of request pause.
- The company's managed rollouts let AI labs keep their trainer in their own environment while Baseten runs the rollouts on the same infrastructure that serves inference for
Cursor, Hubspot,
Lovable and Notion.
- The trainer publishes full checkpoints and small deltas to object storage, and each rollout cluster independently discovers, downloads and applies the new version without blocking the trainer or other clusters.
- Deltas are byte-level XORs of serialized weights from consecutive policies; on Baseten's GLM-5.3 fixture, 716.56 GiB of logical XOR data compressed to 1.55 GiB with zstd.
- Rather than decompress and scan that full output, Baseten's custom decoder reads zstd's literals and sequence commands directly, recording only non-zero literals and skipping match ranges that contain only zeroes.
- The decoder then groups changed bytes into tensor elements, fetches them from CPU memory and applies XOR to produce absolute new values for the GPUs.





