Voice AI BenchmarksBy

OPENAISPEECH-TO-TEXT114,208 SAMPLES / 30 DAYSLAST RUN SEP 15, 2026, 09:00 UTC

official resource

GPT Realtime Whisper speech-to-text benchmarks

GPT Realtime Whisper, hosted by OpenAI, measures mean 551 ms time to final segment (23rd of 28) and 5.1% word error rate (14th of 30) among STT systems. Results cover the last 30 days. Coval benchmarks hosted endpoints daily using a consistent evaluation methodology. Last measured .

GPT Realtime Whisper is Whisper transcription running inside an OpenAI Realtime session, rather than the standalone Audio API.

Time to Final Segment#23 / 28
551ms
Word Error Rate#14 / 30
5.1%
Time to First Token#19 / 26
1814ms

Overview

The path runs within a persistent Realtime connection while still being scored against Coval's standard STT references.

GPT Realtime Whisper is tested every day on fixed public audio — clean, accented, noisy, reverberant, far-field, clipped and phone-codec speech — for transcription accuracy and streaming latency.

Technical specifications

Made by
OpenAI
Hosted by
OpenAI
Source
Official API
Licensing
Proprietary
Deployment
Cloud
Region
US
Features
Multilingual

How GPT Realtime Whisper ranks

Full STT dashboard
Time to Final Segment — every measured STT modelMilliseconds · lower is better · 30-day averageEvery STT model ranked on Time to Final Segment, with GPT Realtime Whisper highlighted.
  1. #1Qwen3 ASR 1.7b39 ms
  2. #2Qwen3 ASR Fast46 ms
  3. #3STT RT v557 ms
  4. #4STT 165 ms
  5. #5Parakeet TDT 0.6B v381 ms
  6. #6Nova 389 ms
  7. #7Nova 292 ms
  8. #8Flux Multilingual98 ms
  9. #9Flux99 ms
  10. #10Ink 2122 ms
  11. #11Whisper Large v3via Baseten125 ms
  12. #12Scribe v2 Realtime133 ms
  13. #13Universal 3.5 Pro173 ms
  14. #14Grok STT207 ms
  15. #15Defaultvia Speechmatics209 ms
  16. #16Pulse212 ms
  17. #17Defaultvia Gradium246 ms
  18. #18resonant-1264 ms
  19. #19Whisper Large v3via Together AI295 ms
  20. #20Enhanced299 ms
  21. #21Gemini 3.5 Transcribe Live305 ms
  22. #22Voxtral Mini Transcribe Realtime 2602401 ms
  23. #23GPT Realtime Whisper551 ms
Show all 28 models
  1. #24GPT-4o mini Transcribe690 ms
  2. #25GPT-4o Transcribe754 ms
  3. #26Chirp 3776 ms
  4. #27Solaria 1805 ms
  5. #28Chirp 2873 ms
median of all models · 208 ms
STT models over the last 30 days, ranked on Time to Final Segment.
#ModelHostTTFSWERTTFTSamples
1Qwen3 ASR 1.7bBaseten39 ms931 ms1,256
2Qwen3 ASR FastNari46 ms1748 ms4,451
3STT RT v5Soniox57 ms1529 ms22,468
4STT 1Inworld AI65 ms1400 ms22,836
5Parakeet TDT 0.6B v3Together AI81 ms1215 ms22,488
6Nova 3Deepgram89 ms1419 ms22,855
7Nova 2Deepgram92 ms1420 ms22,733
8Flux MultilingualDeepgram98 ms1164 ms12,251
9FluxDeepgram99 ms1076 ms12,243
10Ink 2Cartesia122 ms1827 ms22,862
11Whisper Large v3Baseten125 ms912 ms1,252
12Scribe v2 RealtimeElevenLabs133 ms2175 ms22,866
13Universal 3.5 ProAssemblyAI173 ms1041 ms20,253
14Grok STTxAI207 ms—22,853
15DefaultSpeechmatics209 ms1428 ms22,876
16PulseSmallest212 ms2011 ms22,856
17DefaultGradium246 ms1980 ms22,839
18resonant-1Reson8264 ms—22,860
19Whisper Large v3Together AI295 ms1338 ms22,744
20EnhancedSpeechmatics299 ms1492 ms22,876
21Gemini 3.5 Transcribe LiveGemini305 ms1679 ms16,403
22Voxtral Mini Transcribe Realtime 2602Mistral401 ms1851 ms22,583
23GPT Realtime WhisperOpenAI551 ms1814 ms22,812
24GPT-4o mini TranscribeOpenAI690 ms—22,830
25GPT-4o TranscribeOpenAI754 ms—22,831
26Chirp 3Google776 ms5974 ms22,875
27Solaria 1Gladia805 ms1804 ms22,439
28Chirp 2Google873 ms6071 ms22,789
—Nemotron 3.5 ASR StreamingTogether AI—1548 ms22,747
—Universal StreamingAssemblyAI—1514 ms20,235
Under-sampled models are excluded; tied models share a place. Dotted WER values split into substitutions, deletions and insertions on hover or tap.

Highest relative placement: 14th of 30 on Word Error Rate.

Latency vs accuracy

TTFS vs WEREach point is one measured model · GPT Realtime Whisper highlighted · 30-day averagesTime to Final Segment against Word Error Rate for every measured STT model, with GPT Realtime Whisper highlighted.
Qwen3 ASR 1.7b — 39 ms, 4.1%Qwen3 ASR Fast — 46 ms, 3.2%STT RT v5 — 57 ms, 5.7%STT 1 — 65 ms, 4.4%Parakeet TDT 0.6B v3 — 81 ms, 11.2%Nova 3 — 89 ms, 6.2%Nova 2 — 92 ms, 7.9%Flux Multilingual — 98 ms, 8.8%Flux — 99 ms, 6.7%Ink 2 — 122 ms, 4.8%Whisper Large v3 via Baseten — 125 ms, 5.6%Scribe v2 Realtime — 133 ms, 5.5%Universal 3.5 Pro — 173 ms, 3.1%Grok STT — 207 ms, 4.6%Default via Speechmatics — 209 ms, 5.4%Pulse — 212 ms, 5.3%Default via Gradium — 246 ms, 10.0%resonant-1 — 264 ms, 3.4%Whisper Large v3 via Together AI — 295 ms, 8.5%Enhanced — 299 ms, 4.3%Gemini 3.5 Transcribe Live — 305 ms, 3.9%Voxtral Mini Transcribe Realtime 2602 — 401 ms, 6.2%GPT-4o mini Transcribe — 690 ms, 4.9%GPT-4o Transcribe — 754 ms, 4.6%Chirp 3 — 776 ms, 4.1%Solaria 1 — 805 ms, 7.1%Chirp 2 — 873 ms, 4.9%GPT Realtime Whisper — 551 ms, 5.1%

Where the errors come from

WER compositionGPT Realtime Whisper's Word Error Rate split by error type · 30-day averageGPT Realtime Whisper's WER split into substitutions, deletions and insertions.
  • GPT Realtime Whisper5.1%
SubstitutionsDeletionsInsertions

Averages and tail latency

Averages hide slow outliers — these are the distributions behind each figure.

GPT Realtime Whisper latency distributionMilliseconds · shared axis across metrics · last 30 daysGPT Realtime Whisper's latency percentiles per metric: p25–p75 band, p50 tick, whisker to p99.
  • Time to Final Segmentp50 553 ms · p99 847 ms
  • Time to First Tokenp50 1837 ms · p99 3538 ms
band p25–p75 · tick p50 · whisker to p99 with p90 and p95 stops
Average and percentile values per metric, with the number of samples behind each row.
MetricAveragep25p50p75p90p95p99Samples
Time to Final Segment551 ms463 ms553 ms602 ms643 ms673 ms847 ms22,812
Word Error Rate5.1%0.0%0.0%6.3%14.3%22.7%53.6%22,849
Time to First Token1814 ms1530 ms1837 ms2033 ms2311 ms2541 ms3538 ms22,849

Last 30 days

Daily medians from the same measurement runs · gaps are days without qualifying runs.

Time to Final Segment — daily p50Line p50 · band p25–p75 · UTC daysGPT Realtime Whisper's daily median Time to Final Segment over the last 30 days.
GPT Realtime Whisper · Sep 1: 578 msGPT Realtime Whisper · Sep 2: 565 msGPT Realtime Whisper · Sep 3: 572 msGPT Realtime Whisper · Sep 4: 562 msGPT Realtime Whisper · Sep 5: 556 msGPT Realtime Whisper · Sep 6: 539 msGPT Realtime Whisper · Sep 7: 552 msGPT Realtime Whisper · Sep 8: 546 msGPT Realtime Whisper · Sep 9: 547 msGPT Realtime Whisper · Sep 10: 552 msGPT Realtime Whisper · Sep 11: 548 msGPT Realtime Whisper · Sep 12: 515 msGPT Realtime Whisper · Sep 13: 532 msGPT Realtime Whisper · Sep 14: 558 msGPT Realtime Whisper · Sep 15: 539 ms
Word Error Rate — daily averageDaily average · UTC daysGPT Realtime Whisper's daily Word Error Rate over the last 30 days.
GPT Realtime Whisper · Sep 1: 4.6%GPT Realtime Whisper · Sep 2: 5.2%GPT Realtime Whisper · Sep 3: 5.7%GPT Realtime Whisper · Sep 4: 6.0%GPT Realtime Whisper · Sep 5: 5.4%GPT Realtime Whisper · Sep 6: 6.0%GPT Realtime Whisper · Sep 7: 6.5%GPT Realtime Whisper · Sep 8: 5.0%GPT Realtime Whisper · Sep 9: 5.4%GPT Realtime Whisper · Sep 10: 6.4%GPT Realtime Whisper · Sep 11: 5.7%GPT Realtime Whisper · Sep 12: 5.7%GPT Realtime Whisper · Sep 13: 6.6%GPT Realtime Whisper · Sep 14: 6.0%GPT Realtime Whisper · Sep 15: 4.9%

Time to Final Segment by dataset

GPT Realtime Whisper by test conditionMilliseconds · lower is better · best condition firstGPT Realtime Whisper's Time to Final Segment on each benchmark dataset.
  1. WildASR clean543 ms
  2. PipeCat (production)549 ms
  3. WildASR noise gaps550 ms
  4. WildASR far-field551 ms
  5. WildASR phone codec556 ms
  6. WildASR reverb559 ms
  7. WildASR accents565 ms
  8. WildASR clipping568 ms
Time to Final Segment per dataset, with the number of samples behind each figure.
DatasetTTFSSamples
LibriSpeech457 ms1
ProductionPipeCat549 ms11,495
AccentsWildASR565 ms1,115
CleanWildASR543 ms4,570
ClippingWildASR568 ms1,138
Far-fieldWildASR551 ms1,141
Noise gapsWildASR550 ms1,141
Phone codecWildASR556 ms1,136
ReverbWildASR559 ms1,075

Strongest condition: LibriSpeech at 457 ms · weakest: WildASR clipping at 568 ms.

How fast is GPT Realtime Whisper?

On OpenAI, GPT Realtime Whisper measures mean 551 ms time to final segment (23rd of 28) and mean 1814 ms time to first token (19th of 26). Last measured 2026-09-15.

How accurate is GPT Realtime Whisper?

On OpenAI, GPT Realtime Whisper measures 5.1% word error rate (14th of 30). Last measured 2026-09-15.

Who hosts GPT Realtime Whisper?

GPT Realtime Whisper is created by OpenAI and served by OpenAI. Coval measures each hosted endpoint separately.

Limits of this comparison

This path is reported separately because session events and integration behavior differ from standalone audio-transcription requests.

  • The name describes Coval's integration path, and OpenAI can update Realtime defaults independently of standalone Whisper endpoints.

Official sources

Results are re-measured daily using fixed datasets and reported over a rolling 30-day window. Same datasets, prompts and metric definitions for every model, measured by Coval’s open-source runner. Full methodology on the overview.

Evaluate your own voice agent

Use Coval to test your production configuration, prompts and calls—not only the public benchmark endpoints.

Book a Demo