Benchmark Almanac

VoiceCodeBench

GPT Live Transcribe 67.7% tops its leaderboard gpt-4o-transcribe 59.7% leads the models we track Not in model cards

Speech-to-text models transcribe 300 English workplace recordings. They are scored on whether every target entity, such as an address or email, survives exactly.

5.6 hours of audio with 1,482 audited entities across 26 types and 8 workflow domains. Metrics are task success rate, CTEM and WER. 20 systems on 2026-09-24.

Made by besimple.ai (board run by Vals AI) Released Aug 2026 Speech recognition and translation All tasks public Last model added Mar 2026 Scores refreshed 2 Nov 2026
Level
Everyday Most adults, without training
Scored
Checked automatically A program checks the result against an answer key, unit tests or the expected final state.
Answers
Short answer A number, word or short string matched to a key.
Paper Dataset Leaderboard besimple.ai
20
Entries on its own leaderboard, 7 models we track

GPT Live Transcribe tops the leaderboard with 67.7%

Best score per entry from the benchmark's own leaderboard, read on 2 Nov 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is gpt-4o-transcribe, at 59.7%.

The newest model with a score here came out in Mar 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

20 entries. Scroll sideways for the rest.

  1. 67.7 GPT Live Transcribe
  2. 65.3 Grok Voice Transcribe 2.0
  3. 62.0 Cartesia Ink 2
  4. 59.7 gpt-4o-transcribe
  5. 59.3 Deepgram Nova-3 (Streaming)
  6. 59.0 Reson8 Resonant-1
  7. 57.3 Inworld STT 1
  8. 57.0 Muse Voice Transcribe
  9. 57.0 Whisper large-v3-turbo
  10. 55.7 Deepgram Flux General English
  11. 55.3 ElevenLabs Scribe v2 Realtime
  12. 55.3 Google Cloud Chirp 3
  13. 54.3 Whisper large-v3
  14. 53.0 Voxtral Mini Transcribe 2
  15. 52.0 Grok Voice Transcribe 1.0
  16. 51.7 gpt-4o-mini-transcribe
  17. 46.0 Voxtral Mini Transcribe Realtime (2602)
  18. 44.7 Cohere Transcribe
  19. 37.3 Azure Speech Universal Language Model
  20. 30.3 AssemblyAI Universal-3.5 Pro
  1. 1 GPT Live Transcribe 67.7%
  2. 2 Grok Voice Transcribe 2.0 65.3%
  3. 3 Cartesia Ink 2 62%
  4. 4 gpt-4o-transcribe 59.7%
  5. 5 Deepgram Nova-3 (Streaming) 59.3%
  6. 6 Reson8 Resonant-1 59%
  7. 7 Inworld STT 1 57.3%
  8. 8 Muse Voice Transcribe 57%
  9. 9 Whisper large-v3-turbo 57%
  10. 10 Deepgram Flux General English 55.7%
  11. 11 ElevenLabs Scribe v2 Realtime 55.3%
  12. 12 Google Cloud Chirp 3 55.3%
  13. 13 Whisper large-v3 54.3%
  14. 14 Voxtral Mini Transcribe 2 53%
  15. 15 Grok Voice Transcribe 1.0 52%
  16. 16 gpt-4o-mini-transcribe 51.7%
  17. 17 Voxtral Mini Transcribe Realtime (2602) 46%
  18. 18 Cohere Transcribe 44.7%
  19. 19 Azure Speech Universal Language Model 37.3%
  20. 20 AssemblyAI Universal-3.5 Pro 30.3%
#EntryScoreSettingDateSource
1 GPT Live Transcribe 67.7% Official leaderboard
2 Grok Voice Transcribe 2.0 65.3% Official leaderboard
3 Cartesia Ink 2 62% Official leaderboard
4 gpt-4o-transcribe 59.7% Mar 2025 Official leaderboard
5 Deepgram Nova-3 (Streaming) 59.3% Official leaderboard
6 Reson8 Resonant-1 59% Official leaderboard
7 Inworld STT 1 57.3% Official leaderboard
8 Muse Voice Transcribe 57% Official leaderboard
9 Whisper large-v3-turbo 57% Oct 2024 Official leaderboard
10 Deepgram Flux General English 55.7% Official leaderboard
11 ElevenLabs Scribe v2 Realtime 55.3% Official leaderboard
12 Google Cloud Chirp 3 55.3% Official leaderboard
13 Whisper large-v3 54.3% Nov 2023 Official leaderboard
14 Voxtral Mini Transcribe 2 53% Feb 2026 Official leaderboard
15 Grok Voice Transcribe 1.0 52% Official leaderboard
16 gpt-4o-mini-transcribe 51.7% Mar 2025 Official leaderboard
17 Voxtral Mini Transcribe Realtime (2602) 46% Feb 2026 Official leaderboard
18 Cohere Transcribe 44.7% Mar 2026 Official leaderboard
19 Azure Speech Universal Language Model 37.3% Official leaderboard
20 AssemblyAI Universal-3.5 Pro 30.3% Official leaderboard

Number one over time

Lab claims count from the day the card came out, independent runs from the model’s release.

OpenAI
Own leaderboard Not tested since Aug 2026
gpt-4o-transcribe 59.7%

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

On the benchmark’s own leaderboard Best so far
0% 20% 40% 60% 80% 100% 2024 2025 2026 Near the ceiling (85%) gpt-4o-transcribe Whisper large-v3-turbo Whisper large-v3 0% 20% 40% 60% 80% 100% 2024 2025 2026 Near the ceiling (85%) gpt-4o-transcribe

No lab model card reports it yet

We read the headline results of 479 launch posts from 51 labs, and none of them list this benchmark.

More in Audio and video

All 168 in Audio and video
  • Video-MMMU In use 300 expert-level lecture videos with questions testing perception, comprehension and adaptation of knowledge. Accuracy. Qwen 3.8 Max 88.7%
  • LVBench In use Hours-long video understanding with multiple-choice questions on reasoning, grounding and summarization. Gemini 4 Argon 91.7%
  • MMVU In use 3,000 expert-annotated questions on videos across 27 disciplines. Multiple-choice and open-ended accuracy. Qwen 3.8 Max 82.4%
  • MLVU In use Multi-task long video understanding (minutes to hours) with multiple-choice and generation tasks. Accuracy. Qwen 3.8 Max 90.8%
  • VoiceBench In use Spoken instructions with speaker, environment and content variation. Voice assistant responses scored by GPT judge or rules. Qwen3.5-Omni-Plus 93.1%
  • TVBench In use Models answer multiple-choice questions on 10 temporal video tasks, such as action counting and ordering, that static frames cannot solve. Scored by accuracy. Qwen 3.8 Max 81.9%