Together AI· Inference platformCapability change

Improved Batch Inference API: Enhanced UI, Expanded Model Support, and 3000× Rate Limit Increase

Together AI announced major improvements to its Batch Inference API, including a streamlined UI, support for all serverless models and private deployments, a 3000x rate limit increase (from 10M to 30B tokens), and 50% cost reduction compared to the real-time API.

From the source

Rate limits are up from 10M to 30B enqueued tokens per model per user, a 3000× increase.

together.ai

Announced

15 Sep 2025 00:00 UTC

Detected

03 Aug 2026 21:12 UTC (+322d after)

Pricing