From the source
Apple researchers present a method for compressing streaming neural audio encoders used in on-device dictation through latent-space distillation.
- The technique trains a student encoder to regress the teacher's pre-quantizer latent representation, achieving 2.8× compression while maintaining within 1.9% relative word error rate of the teacher on most model pairs without fine-tuning.