# Amazon — Introducing usage-based pricing for Amazon SageMaker AI bidirectional streaming

- Company: Amazon (amazon.com)
- Announced: 2026-11-11T15:10:23+00:00
- Category: pricing-change
- Coverage: not counted
- Announcement: yes
- Group: announcements
- Source: https://aws.amazon.com/blogs/machine-learning/introducing-usage-based-pricing-for-amazon-sagemaker-ai-bidirectional-streaming/
- Record: https://forck.live/items/34658-introducing-usage-based-pricing-for-amazon-sagemaker-ai-bidirectional-streaming
- Subject: Bedrock / Nova
- Pricing: The listing shows one price per unit, labeled per request, with up to three decimal places.

Amazon is adding usage-based metering to SageMaker AI bidirectional streaming so AWS Marketplace model providers can bill for what customers actually consume during a live session. Deepgram, the real-time speech AI company, is the launch partner, bringing usage-based Speech-to-Text and Text-to-Speech billing to AWS Marketplace. The change answers a billing gap: request-response metering reports a unit count in an HTTP response header, but a streaming session can last 30 seconds or 30 minutes and its final total is not known until it ends. Model servers opt in by returning the header X-Amzn-SageMaker-Metadata-Stream-Supported: true, after which SageMaker AI opens a companion WebSocket at /invocations-bidirectional-stream-metadata for JSON metering records. The metadata stream allows one message per second per connection with a maximum message size of 512 bytes, and Amazon recommends sending records incrementally as usage accrues so less goes unreported if a session ends unexpectedly. SageMaker AI endpoint infrastructure charges still apply while the endpoint is provisioned, and Amazon notes that transport delivery alone does not establish that usage has been billed.

## Evidence

Verbatim from https://aws.amazon.com/blogs/machine-learning/introducing-usage-based-pricing-for-amazon-sagemaker-ai-bidirectional-streaming/:

> Usage-based metering for bidirectional streaming solves a software billing problem for real-time speech AI. Customers deploying streaming models on Amazon SageMaker AI bidirectional streaming pay for the endpoint infrastructure that hosts the model. Separately, model providers listing on AWS Marketplace need a way to charge for what customers consume during a live stream. Today, we’re announcing usage-based metering for Amazon SageMaker bidirectional (bidi) streaming inference, so model providers can report actual usage for the AWS Marketplace software charge. Amazon SageMaker AI endpoint infrastructure charges still apply.
> 
> Deepgram , the real-time speech AI company, is the launch partner for this capability, bringing usage-based Speech-to-Text (STT) and Text-to-Speech (TTS) billing to AWS Marketplace. This post builds on a series of innovations between Deepgram and AWS. First, we introduced bidirectional streaming for real-time inference on Amazon SageMaker AI , which supports long-lived bidirectional streams between clients and model servers.

---

Record: https://forck.live/items/34658-introducing-usage-based-pricing-for-amazon-sagemaker-ai-bidirectional-streaming
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md
