DATASETTTSCOVAL BENCHMARK ROTATIONACTIVE

manifest

Agent passages text-to-speech benchmark dataset

Agent passages is a text-to-speech test set in Coval's daily rotation — every measured text-to-speech model runs the same fixed inputs from it.

Items
0
fixed public inputs
Models measured
32
last 30 days
Current leader · TTFA#1 / 32
40ms
vuivia Fluxions

How models rank on Agent passages

Full TTS dashboard
Time to First Audio on Agent passagesMilliseconds · lower is better · 30-day average on this datasetEvery TTS model measured on the Agent passages dataset, ranked on Time to First Audio.
  1. #1vui40 ms
  2. #2Default62 ms
  3. #3PhantomZ 4.064 ms
  4. #4TTS Flash 268 ms
  5. #6Simba 3.2101 ms
  6. #7Qwen3 TTS 1.7b105 ms
  7. #8Palabra TTS107 ms
  8. #9Simba 3.0113 ms
  9. #10Simba 3.5114 ms
  10. #11Falcon 2139 ms
  11. #12TTS 2163 ms
Show all 32 models
  1. #13Flash v2.5215 ms
  2. #14Flux TTS218 ms
  3. #17Coda254 ms
  4. #18Airy TTS273 ms
  5. #19Sonic 3.6287 ms
  6. #20TTS Rt v2288 ms
  7. #21TTS RT v1288 ms
  8. #23Grok TTS311 ms
  9. #24Aura 2313 ms
  10. #26Daytona TTS347 ms
  11. #27S2.1 Pro383 ms
  12. #28Mist v3397 ms
  13. #29Aura 2 En515 ms
  14. #30Chirp 3 HD569 ms
  15. #32S2.1 Pro Free842 ms
median of all models · 237 ms
TTS models on the Agent passages dataset over the last 30 days, ranked on Time to First Audio.
#ModelHostTTFAWERSamples
1vuiFluxions40 ms2,870
2Gradium TTS Beta 202609Gradium62 ms2,876
3Phantom Z 3.4 conversationalDeepdub64 ms2,872
4TTS Flash 2Inworld AI68 ms2,876
5Qwen3 TTS FastNari Labs69 ms2,876
6Simba 3.2SpeechifyAI101 ms2,875
7Qwen3 TTS 1.7bBaseten105 ms2,875
8Palabra TTS v1Palabra107 ms2,469
9Simba 3.0SpeechifyAI113 ms2,876
10Simba 3.5SpeechifyAI114 ms1,759
11Falcon 2Murf139 ms2,875
12TTS 2Inworld AI163 ms2,874
13Flash v2.5ElevenLabs215 ms2,872
14Flux TTSDeepgram218 ms2,378
15Eleven v4 TurboElevenLabs218 ms2,875
16Assemblyai TTS 1AssemblyAI220 ms2,526
17CodaRime254 ms1,882
18Airy TTSOut of Set273 ms2,789
19Sonic 3.6Cartesia287 ms1,933
20TTS Rt v2Soniox288 ms2,379
21TTS RT v1Soniox288 ms2,395
22Drama 3 Preview Us EastFish Audio293 ms2,875
23Grok TTSSpaceXAI311 ms2,876
24Aura 2Deepgram313 ms2,529
25Lightning v3.1 ProSmallest327 ms2,868
26Daytona TTSGuava347 ms2,880
27S2.1 ProFish Audio383 ms2,871
28Mist v3Rime397 ms1,882
29Aura 2 EnCloudflare515 ms2,866
30Chirp 3 HDGoogle569 ms2,875
31Qwen3 TTS Flash RealtimeAlibaba722 ms2,875
32S2.1 Pro FreeFish Audio842 ms2,857
Under-sampled models are excluded; tied models share a place. Dotted WER values split into substitutions, deletions and insertions on hover or tap.

Inside the dataset

0 fixed public inputs — every model is tested on exactly these.

Source: Coval TTS v2 authoring bank (private); remote manifest also carries the tts-v1 prompts · License: Proprietary

Metrics reported for this dataset

Same datasets, prompts and metric definitions for every model, measured by Coval’s open-source runner. Full methodology on the overview.

Evaluate your own voice agent

Use Coval to test your production configuration, prompts and calls—not only the public benchmark endpoints.

Book a Demo