# Hume — Hume Audio Decision Benchmarks

- Company: Hume (hume.ai)
- Announced: 2026-11-13T16:00:00+00:00
- Category: new-model
- Coverage: not counted
- Announcement: yes
- Group: models
- Source: https://www.hume.ai/blog/hume-audio-decision-benchmarks
- Record: https://forck.live/items/35951-hume-audio-decision-benchmarks
- Subject: EVI / Octave
- Models affected: Hume Audio Decision, Gemini 4 Hydrogen, Gemini Decision 1, Qwen3.8-Omni-Flash, Gemini 3.8 Flash

Hume has introduced Hume Audio Decision, a model that estimates how people would judge an audio clip without needing a transcript, answering questions such as how natural a voice sounds. The output is a distribution over answers, showing how listeners split when they disagree, rather than a single verdict. In tests on four public human-preference benchmarks, AudioMOS-AES, NISQA, SOMOS and DataPoint, Hume says the model scored highest across 11 models, a comparison that includes Google's Gemini 4 Hydrogen and Gemini Decision 1. Hume also compared the model with individual raters: in six of seven comparisons it agreed with the rest of the crowd more closely than a single held-out rater did. On DataPoint, a single held-out rater picked the crowd's majority answer 56.7% of the time, while Hume Audio Decision picked it 68.6% of the time. Hume reports the lowest mean latency it measured, 0.22 seconds per question, and says the model costs less than every model that scored 0.73 or higher overall. On the overall score, the mean of the three group means, Hume Audio Decision ranks first at 0.800, ahead of Gemini 3.8 Flash at 0.770 and Gemini 4 Hydrogen at 0.755.

## Evidence

Verbatim from https://www.hume.ai/blog/hume-audio-decision-benchmarks:

> Predicting a listening test in one API call
> 
> Before shipping a voice, codec, or speech pipeline, teams need to know how human the voice sounds. That usually means running a listening test: recruiting raters, collecting judgments, and waiting for results. Even a straightforward question like “Does this voice sound natural?” takes time and money to answer.
> 
> Our new decision model, Hume Audio Decision , estimates how people would judge an audio clip without needing a transcript. Send a clip and a question, and the model predicts the share of human raters who would choose each answer, such as each rating on a five-point naturalness scale. The output is a distribution over answers, showing how listeners split when they disagree.
> 
> In our tests on four public human-preference benchmarks (AudioMOS-AES, NISQA, SOMOS, and DataPoint), Hume Audio Decision scored highest across 11 models. The comparison includes Google’s newest general model, Gemini 4 Hydrogen, and Google’s decision model, Gemini Decision 1, which also returns a distribution of answers.
> 
> We also compared Hume Audio Decision with individual human raters.

---

Record: https://forck.live/items/35951-hume-audio-decision-benchmarks
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md
