Benchmark Almanac

DesignArena Audio Realism Bench

Not in model cards

Voice models produce conversational speech, and users vote on which sounds more real. DesignArena built it because 1 to 5 opinion scores for TTS had saturated.

DesignArena introduced it in the post Audio Realism Benchmark: Measuring Realism in Audio Models. It reports artificial speech and human speech views. One of 33 DesignArena boards. DesignArena ranks entries with Bradley-Terry ratings from user votes. Its terms forbid automated reading, so the almanac imports no scores.

Made by DesignArena (Intelligence) Audio understanding and voice All tasks public
Level
Everyday Most adults, without training
Scored
Ranked by votes People pick the better of two answers, as in an arena, and the votes are turned into ratings.
Answers
Open-ended Free-form text, documents, designs or media judged as a whole.

No scores here yet

Design Arena’s terms don’t allow automated reading, so we link to its board instead.

See the live leaderboard on designarena.ai

No lab model card reports it yet

We read the headline results of 479 launch posts from 51 labs, and none of them list this benchmark.

More in Audio and video

All 168 in Audio and video
  • Video-MMMU In use 300 expert-level lecture videos with questions testing perception, comprehension and adaptation of knowledge. Accuracy. Qwen 3.8 Max 88.7%
  • LVBench In use Hours-long video understanding with multiple-choice questions on reasoning, grounding and summarization. Gemini 4 Argon 91.7%
  • MMVU In use 3,000 expert-annotated questions on videos across 27 disciplines. Multiple-choice and open-ended accuracy. Qwen 3.8 Max 82.4%
  • MLVU In use Multi-task long video understanding (minutes to hours) with multiple-choice and generation tasks. Accuracy. Qwen 3.8 Max 90.8%
  • VoiceBench In use Spoken instructions with speaker, environment and content variation. Voice assistant responses scored by GPT judge or rules. Qwen3.5-Omni-Plus 93.1%
  • TVBench In use Models answer multiple-choice questions on 10 temporal video tasks, such as action counting and ordering, that static frames cannot solve. Scored by accuracy. Qwen 3.8 Max 81.9%