From the source
Artificial Analysis releases Big Bench Audio, a new evaluation dataset for assessing audio reasoning, and presents benchmark results for GPT-4o and Gemini 1.5 series models across speech and text modalities, revealing a significant speech reasoning gap.






