From the source
To deploy a custom inference handler on Hugging Face Inference Endpoints that combines Whisper for ASR, a Pyannote model for diarization, and an assistant model for speculative decoding, with code examples and configuration details.
Powerful ASR + diarization + speculative decoding with Hugging Face Inference Endpoints
From the source
We'll solve this challenge using a custom inference handler, which will implement the Automatic Speech Recognition (ASR) and Diarization pipeline on Inference Endpoints, as well as supporting speculative decoding.
huggingface.co
