Improved Batch Inference API: Enhanced UI, Expanded Model Support, and 3000× Rate Limit Increase
Capability change
Together AI announced major improvements to its Batch Inference API, including a streamlined UI, support for all serverless models and private deployments, a 3000x rate limit increase (from 10M to 30B tokens), and 50% cost reduction compared to the real-time API.
