# Amazon — Cost-optimizing AssemblyAI speech-to-text inference on AWS with Amazon EC2 Spot

- Company: Amazon (amazon.com)
- Announced: 2026-11-13T19:35:35+00:00
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://aws.amazon.com/blogs/machine-learning/cost-optimizing-assemblyai-speech-to-text-inference-on-aws-with-amazon-ec2-spot/
- Record: https://forck.live/items/36044-cost-optimizing-assemblyai-speech-to-text-inference-on-aws-with-amazon-ec2-spot
- Subject: Bedrock / Nova

Amazon's post explains how AssemblyAI runs its speech-to-text inference on Amazon EC2 Spot Instances to cut GPU costs while keeping its SLA commitments. Speech-to-text inference is computationally intensive, with each audio file triggering a pipeline of deep learning models on NVIDIA GPUs, which at scale means thousands of GPU instances running continuously. Running entirely on On-Demand Instances would be cost-prohibitive, and Spot Instances can be reclaimed with a 2-minute warning, so AssemblyAI needed an architecture that absorbs interruptions gracefully. The platform runs on Amazon ECS with capacity providers that mix Spot and On-Demand capacity, spanning g4dn, g5 and g6 GPU instance families and using the price-capacity optimized allocation strategy. When a Spot Instance gets an interruption notice, an EventBridge-triggered Lambda returns the in-flight job to the Main Job SQS Queue for another ECS task to pick up, and jobs that exhaust retries go to a Dead Letter SQS Queue. AssemblyAI deploys regionally in US West (Oregon) us-west-2 and Europe (London) eu-west-2 to meet data residency rules for customers in healthcare, finance and legal.

## Evidence

Verbatim from https://aws.amazon.com/blogs/machine-learning/cost-optimizing-assemblyai-speech-to-text-inference-on-aws-with-amazon-ec2-spot/:

> Speech-to-text inference is computationally intensive. Each audio file triggers a pipeline of deep learning models (acoustic models, language models, and post-processing stages) running on NVIDIA GPUs to meet latency requirements. At scale, this means thousands of GPU instances running continuously.
> 
> AssemblyAI needed a way to run GPU-intensive inference workloads cost-effectively at scale, without sacrificing the availability and latency guarantees their customers depend on. Running entirely on On-Demand Instances would be cost-prohibitive. Spot Instances offer significant savings, while Amazon Elastic Compute Cloud (Amazon EC2) can reclaim them with a 2-minute warning when capacity is needed elsewhere. AssemblyAI needed an architecture that absorbs Spot interruptions gracefully while maintaining service level agreement (SLA) commitments. Additionally, customers in regulated industries, including healthcare, finance, and legal, must keep audio data within specific geographic boundaries. They implement strict data residency configurations in European AWS Regions.

---

Record: https://forck.live/items/36044-cost-optimizing-assemblyai-speech-to-text-inference-on-aws-with-amazon-ec2-spot
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md
