# Baseten — How Baseten makes pyannote’s diarization models 9.6x faster

- Company: Baseten (baseten.co)
- Announced: 2026-09-09
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://www.baseten.co/blog/how-baseten-makes-pyannotes-diarization-models-96x-faster
- Record: https://forck.live/items/32771-how-baseten-makes-pyannote-s-diarization-models-9-6x-faster
- Subject: Baseten
- Open weights: yes
- Models affected: Community-1, Precision-2

Baseten says it optimized pyannote's Community-1 and Precision-2 speaker diarization models, cutting long-audio latency by up to 9.6x and raising throughput by 3.2x. The company says the work answers a production problem: high-quality diarization models are slow and costly to run, while cheaper ones are not good enough for voice products. Baseten combined quality-aware quantization, index-based clustering and scheduling changes, including fusing the pipeline into a single forward pass and cutting CPU-to-GPU memory transfers. The indexing strategy lets a single GPU diarize 20 hours of audio in two minutes, a job Baseten says the unoptimized pipeline cannot finish in one request. Mixed precisions across the pipeline lifted Precision-2 throughput by 3.2x with a 0.5% absolute DER penalty, while the clustering loop runs in float64 on the GPU. On VoxConverse, Baseten reports 11.1% DER for Community-1 and 8.8% for Precision-2, which it calls state-of-the-art for models of their size and speed. Baseten says it will soon add voiceprint enrollment and cross-session speaker identification to its diarization deployments.

## Evidence

Verbatim from https://www.baseten.co/blog/how-baseten-makes-pyannotes-diarization-models-96x-faster:

> Pyannote’s Community and Precision research models add state-of-the-art speaker attribution to your ASR workloads, but serving them efficiently required careful optimization. We combined quality-aware quantization, index-based clustering algorithms, and scheduling optimizations to reduce latency by up to 9.6x and increase throughput by 3x on long audio, unlocking rapid diarization at scale.
> 
> Speaker diarization — figuring out who spoke when in an audio recording — is one of the harder problems in speech AI, and one of the most useful once it works: meeting notes, call-center analytics, podcast transcripts, and media archives all depend on knowing which voice said what.
> 
> The problem is that high-quality models are typically slow and expensive to run, while affordable models are often not good enough for people building voice products. Additionally, running diarization in production workloads at scale also comes with a unique set of challenges because of how these models operate.

---

Record: https://forck.live/items/32771-how-baseten-makes-pyannote-s-diarization-models-9-6x-faster
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md
