From the source
Baseten added deferred tool loading to open models on its Model APIs, so agents stop paying for tool schemas they never use.
- The company says gateways serving open models had fallen behind because Codex and Claude Code turn deferred tool loading off when pointed at third-party open model providers, and it requires specific server-side gateway and inference work.
- Deferred loading keeps tool schemas out of the system prompt and gives the model a search tool; with three MCP servers registered, schemas added about 141k tokens to every request, which deferred loading cut to about 1.3k.
- Baseten says the technique is supported for
DeepSeek, Kimi and GLM on its Model APIs in Chat Completions and Messages API formats.
- In Claude Code with Slack, Notion and Baseten MCPs on, coding benchmarks were on average 62.5% cheaper and 26.2% faster, while agentic benchmarks using the benchmarks' own tools were 51.1% cheaper and 14.9% faster.
- The measurements came from 55 tasks drawn from eight benchmarks, run with GLM 5.3 with and without deferred tool loading.






