From the source
You can add realtime voice, text to speech, and speech to text with the same calls you already use for text, image, and video, routed through AI Gateway alongside every other modality.
Audio launches with models from OpenAI and
xAI .
Each call gets the same provider routing, observability, spend controls, and bring-your-own-key support you already use for your other models.
These capabilities are in beta and available in AI SDK 7.
Capability How it works Use it for Realtime voice Live audio in and out, for streaming, low-latency session Two-way voice agents and live conversation Text to speech Text in, audio file out, single request Voiceovers, spoken responses, audio versions of written content Speech to text Recorded audio in, text out, single request Transcribing voice notes, call recordings Copy link to heading Getting started Realtime, speech, and transcription model are supported on AI SDK 7 . npm install ai @ai-sdk/react @ai-sdk/gateway Copy link to heading Realtime voice agents Realtime turns your app into something a user can hold a conversation with.
When they speak, the model responds right away.
…
