# Hume — Measuring benchmark optimization in speech recognition

- Company: Hume (hume.ai)
- Announced: 2026-08-21T14:00:00+00:00
- Category: research-paper
- Coverage: not counted
- Announcement: yes
- Group: announcements
- Source: https://www.hume.ai/blog/measuring-benchmark-optimization-in-speech-recognition
- Record: https://forck.live/items/8034-measuring-benchmark-optimization-in-speech-recognition
- Subject: EVI / Octave

Hume introduced three tests to quantify benchmark optimization in speech recognition. The research found that top open-source ASR models reproduce benchmark transcripts even when the audio contradicts them.

## Evidence

Verbatim from https://www.hume.ai/blog/measuring-benchmark-optimization-in-speech-recognition:

> New research introduces three tests to quantify benchmark optimization in speech recognition, finding top open-source ASR models reproduce benchmark transcripts even when the audio contradicts them.

---

Record: https://forck.live/items/8034-measuring-benchmark-optimization-in-speech-recognition
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md