From the source
Lead story
Ask your AI
Top stories
Models & availability
Latest
Canary rollouts: upgrade models in production without downtime
Staged model upgrades with metric gates and automatic rollback
Together AI released canary rollouts, a feature for upgrading models in production without downtime.
The system uses staged traffic ramps, metric gates, and automatic rollback on dedicated inference, allowing operators to migrate traffic between two deployments with health checks and optional performance gates at each step.
From the source
Rollouts move live traffic from your current model to a new checkpoint in gated steps. Health checks always run before traffic moves; on a canary you can also add metric gates (say p95 latency or error rate) that run after each step.
together.ai
Other stories
Amazon · 2 OctSweep thousands of leases for compliance using Amazon Quick and the Adjudicated Query patternAmazon · 2 OctAdd secure Web Search to Claude Desktop with Amazon Bedrock AgentCoreAmazon · 2 OctFine-tune a search agent with multi-turn RL on Amazon SageMaker AI