From the source
From the source
A lightweight method detects code-switching directly from speech using pretrained encoders.
Apple researchers propose a lightweight method to detect code-switching directly from speech using frame-level language information in pretrained speech encoders.
The Whisper-small encoder achieves a mean F1 of 0.798 across 14 language pairs in CS-FLEURS, outperforming CNN and HuBERT baselines.
From the source
We propose a lightweight method that detects CS directly from speech. It uses frame-level language information in pretrained speech encoders to determine whether both languages are present within an utterance.
machinelearning.apple.com