# Unite.AI — Baseten Opens Voice Agent Stack and Realtime Voice in Private Preview

- Company: Unite.AI (unite.ai)
- Announced: 2026-11-16T18:06:02+00:00
- Category: product-launch
- Coverage: not counted
- Announcement: yes
- Group: announcements
- Source: https://www.unite.ai/baseten-opens-voice-agent-stack-and-realtime-voice-in-private-preview/
- Record: https://forck.live/items/36821-baseten-opens-voice-agent-stack-and-realtime-voice-in-private-preview
- Subject: Reporting
- Models affected: Qwen3-ASR, Gemma-4-31B, Qwen3-TTS, GLM-5.3 Fast, Qwen3 ASR 1.7b
- Context window: contexts up to 16,000 tokens
- Pricing: $0.012 per audio minute at 32 concurrent sessions, excluding the per-token cost of reasoning-model delegation, and $0.008 per call-minute at 56 sessions including Model API delegation

Baseten opened the Voice Agent Stack and Baseten Realtime Voice to private preview through a waitlist on November 16, 2026, reporting roughly one-second median turn latency across up to 56 concurrent sessions in its test setup. The stack runs on Baseten Dedicated Inference, placing the orchestrator and speech models in one cloud region over an in-cluster network, because Baseten says a remote orchestrator can add hundreds of milliseconds of network round trips per turn even when all speech components are hosted on its platform. Realtime Voice is the reference implementation, running a cascade of Baseten-optimized open-weight models with a custom Pipecat-based orchestrator, and an optional delegation design keeps a co-located talker model on conversation while a stronger external thinker model handles reasoning, web search and tool calls asynchronously. Customers can pick the speech-to-text, language and text-to-speech models independently, combine dedicated components with third-party APIs, and switch a session's language model, voice or transcription route without redeployment. The API matches the core OpenAI Realtime event protocol, but OpenAI's Python SDK cannot connect directly because it appends /realtime to its base URL, a path Baseten's endpoint does not serve, and browser clients need a backend to hold the API key and relay the socket. Baseten reported median time to first audio rising from 0.94 seconds with one concurrent call to 1.14 seconds at 56, and estimated $0.012 per audio minute at 32 concurrent sessions and $0.008 per call-minute at 56 sessions under its stated utilization assumptions. An independent Coval leaderboard timestamped 17:30 UTC on November 16, 2026 ranked Baseten-hosted Qwen3 ASR 1.7b second by median Time to Final Segment at 33 milliseconds, with a 2.1% word error rate over 456 samples.

## Evidence

Verbatim from https://www.unite.ai/baseten-opens-voice-agent-stack-and-realtime-voice-in-private-preview/:

> Co-locating orchestration with speech models removes network round trips that remote orchestrators add per turn.
> 
> Baseten's stack lets operators scale each pipeline stage independently instead of duplicating the full pipeline.
> 
> OpenAI SDK clients cannot connect directly because Baseten's endpoint does not serve the appended realtime path.
> 
> Baseten announced the Voice Agent Stack and Baseten Realtime Voice on November 16, 2026, opening both to private preview through a waitlist and reporting roughly one-second median turn latency across up to 56 concurrent sessions in its test setup. The stack co-locates speech models and orchestration, lets customers choose models independently and scales each pipeline component separately.
> 
> Co-Located Infrastructure
> 
> The Voice Agent Stack runs on Baseten Dedicated Inference , placing the orchestrator and models in one cloud region over an in-cluster network. Baseten said a remote orchestrator can add hundreds of milliseconds of network round trips per turn even when the speech-to-text, language and text-to-speech components are all hosted on its platform.

---

Record: https://forck.live/items/36821-baseten-opens-voice-agent-stack-and-realtime-voice-in-private-preview
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md
