GRADIUMSPEECH-TO-TEXT136,820 SAMPLES / 30 DAYSLAST RUN NOV 2, 2026, 09:00 UTC
Default speech-to-text benchmarks
Default, hosted by Gradium, measures mean 261 ms time to final segment (21st of 28) and 8.4% word error rate (28th of 30) among STT systems. Results cover the last 30 days. Coval benchmarks hosted endpoints daily using a consistent evaluation methodology. Last measured .
Coval has active speech-to-text measurements for Default, created by Gradium and served through Gradium's own API.
- Time to Final Segment#21 / 28
- 261ms
- Word Error Rate#28 / 30
- 8.4%
- Time to First Token#22 / 28
- 2005ms
Overview
Default is tested every day on fixed public audio — clean, accented, noisy, reverberant, far-field, clipped and phone-codec speech — for transcription accuracy and streaming latency.
How Default ranks
Full STT dashboard- #1Qwen3 ASR 1.7bDedicated inference. Shared endpoints serve many customers on the same infrastructure, while dedicated endpoints run on hardware reserved for a single customer.35 ms
- #12Whisper Large v3via BasetenDedicated inference. Shared endpoints serve many customers on the same infrastructure, while dedicated endpoints run on hardware reserved for a single customer.126 ms
Show all 28 modelsShow fewer
- #7Qwen3 ASR 1.7bDedicated inference. Shared endpoints serve many customers on the same infrastructure, while dedicated endpoints run on hardware reserved for a single customer.2.9%
- #16Whisper Large v3via BasetenDedicated inference. Shared endpoints serve many customers on the same infrastructure, while dedicated endpoints run on hardware reserved for a single customer.4.5%
Show all 30 modelsShow fewer
- #1Whisper Large v3via BasetenDedicated inference. Shared endpoints serve many customers on the same infrastructure, while dedicated endpoints run on hardware reserved for a single customer.914 ms
- #2Qwen3 ASR 1.7bDedicated inference. Shared endpoints serve many customers on the same infrastructure, while dedicated endpoints run on hardware reserved for a single customer.936 ms
Show all 28 modelsShow fewer
| # | Model | Host | TTFS | WER | TTFT | Samples |
|---|---|---|---|---|---|---|
| 1 | Qwen3 ASR 1.7b | Baseten | 35 ms | 936 ms | 13,678 | |
| 2 | STT RT v5 | Soniox | 44 ms | 1525 ms | 27,365 | |
| 3 | Qwen3 ASR Fast | Nari Labs | 50 ms | 1755 ms | 27,371 | |
| 4 | STT 1 | Inworld AI | 70 ms | 1026 ms | 27,334 | |
| 5 | Nova 3 | Deepgram | 85 ms | 1444 ms | 27,364 | |
| 6 | Nova 2 | Deepgram | 87 ms | 1427 ms | 27,311 | |
| 7 | Parakeet TDT 0.6B v3 | Together AI | 88 ms | 1197 ms | 15,445 | |
| 8 | Flux Multilingual | Deepgram | 100 ms | 1174 ms | 27,365 | |
| 9 | Flux | Deepgram | 101 ms | 1097 ms | 27,371 | |
| 10 | Universal 3.6 Pro | AssemblyAI | 114 ms | 1079 ms | 27,335 | |
| 11 | Scribe v2 Realtime | ElevenLabs | 118 ms | 2151 ms | 27,366 | |
| 12 | Whisper Large v3 | Baseten | 126 ms | 914 ms | 13,674 | |
| 13 | Universal 3.5 Pro | AssemblyAI | 126 ms | 1019 ms | 27,373 | |
| 14 | Ink 2 | Cartesia | 146 ms | 2034 ms | 27,369 | |
| 15 | Realtime Global | Reson8 | 159 ms | 2060 ms | 22,469 | |
| 16 | Whisper Large v3 | Together AI | 174 ms | 1210 ms | 15,513 | |
| 17 | Grok STT | SpaceXAI | 180 ms | — | 27,332 | |
| 18 | Pulse | Smallest | 203 ms | 1988 ms | 27,366 | |
| 19 | resonant-1 | Reson8 | 243 ms | — | 27,372 | |
| 20 | Linden 1 | Speechmatics | 254 ms | 1528 ms | 27,368 | |
| 21 | Default | Gradium | 261 ms | 2005 ms | 27,364 | |
| 22 | Gemini 3.5 Transcribe Live | Gemini | 383 ms | 1542 ms | 27,270 | |
| 23 | Daytona STT | Guava | 384 ms | 5651 ms | 13,133 | |
| 24 | Solaria 1 | Gladia | 414 ms | 1608 ms | 27,306 | |
| 25 | Voxtral Mini Transcribe Realtime 2602 | Mistral | 436 ms | 1867 ms | 20,731 | |
| 26 | GPT Realtime Whisper | OpenAI | 563 ms | 1822 ms | 26,862 | |
| 27 | Chirp 3 | 807 ms | 6007 ms | 27,330 | ||
| 28 | Chirp 2 | 895 ms | 6097 ms | 27,368 | ||
| — | Nemotron 3.5 ASR Streaming | Together AI | — | 1557 ms | 15,422 | |
| — | Universal Streaming | AssemblyAI | — | 1516 ms | 27,339 |
Latency vs accuracy
Where the errors come from
- Default8.4%
Averages and tail latency
Averages hide slow outliers — these are the distributions behind each figure.
- Time to Final Segmentp50 246 ms · Max 22223 ms
- Time to First Tokenp50 1964 ms · Max 19283 ms
- Defaultp50 5.0% · Max 100.0%
| Metric | Average | p25 | p50 | p75 | p90 | p95 | Max | Samples |
|---|---|---|---|---|---|---|---|---|
| Time to Final Segment | 261 ms | 221 ms | 246 ms | 288 ms | 314 ms | 336 ms | 22223 ms | 27,364 |
| Word Error Rate | 8.4% | 0.0% | 5.0% | 12.9% | 24.0% | 33.3% | 100.0% | 27,364 |
| Time to First Token | 2005 ms | 1655 ms | 1964 ms | 2247 ms | 2639 ms | 2842 ms | 19283 ms | 27,364 |
Last 30 days
Daily medians from the same measurement runs · gaps are days without qualifying runs.
Time to Final Segment by dataset
- PipeCat (production)240 ms
- WildASR clean263 ms
- WildASR clipping276 ms
- WildASR noise gaps281 ms
- WildASR far-field294 ms
- WildASR phone codec295 ms
- WildASR accents361 ms
| Dataset | TTFS | Samples |
|---|---|---|
| ProductionPipeCat | 240 ms | 14,408 |
| AccentsWildASR | 361 ms | 1,441 |
| CleanWildASR | 263 ms | 5,760 |
| ClippingWildASR | 276 ms | 1,442 |
| Far-fieldWildASR | 294 ms | 1,435 |
| Noise gapsWildASR | 281 ms | 1,439 |
| Phone codecWildASR | 295 ms | 1,439 |
Strongest condition: PipeCat (production) at 240 ms · weakest: WildASR accents at 361 ms.
How fast is Default?
On Gradium, Default measures mean 261 ms time to final segment (21st of 28) and mean 2005 ms time to first token (22nd of 28). Last measured 2026-11-02.
How accurate is Default?
On Gradium, Default measures 8.4% word error rate (28th of 30). Last measured 2026-11-02.
Who hosts Default?
Default is created by Gradium and served by Gradium. Coval measures each hosted endpoint separately.
Results are re-measured daily using fixed datasets and reported over a rolling 30-day window. Same datasets, prompts and metric definitions for every model, measured by Coval’s open-source runner. Full methodology on the overview.
Evaluate your own voice agent
Use Coval to test your production configuration, prompts and calls—not only the public benchmark endpoints.