# Hugging Face — Measuring benchmark optimization in speech recognition

- Company: Hugging Face (huggingface.co)
- Announced: 2026-08-21T00:00:00+00:00
- Category: product-launch
- Subject: Platform
- Open weights: yes
- Source: https://huggingface.co/blog/asr-benchmark-optimization
- Record: https://forck.live/items/4244-measuring-benchmark-optimization-in-speech-recognition

Hugging Face introduced held-out sets in three speech recognition leaderboards to better measure real-world performance and address benchmark optimization.

## Evidence

Verbatim from https://huggingface.co/blog/asr-benchmark-optimization:

> That's why we recently introduced held-out sets in Real World VoiceEQ , the Open-ASR Leaderboard , and the Far-field ASR Leaderboard : to measure more of what matters in real-world use.

---

Record: https://forck.live/items/4244-measuring-benchmark-optimization-in-speech-recognition
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md