Voice AI BenchmarksBy

DATASETTTSCOVAL PROMPT MANIFESTACTIVE

manifest

Text prompts text-to-speech benchmark dataset

30 short text prompts that every text-to-speech model synthesizes.

Items
30
fixed public inputs
Models measured
29
last 30 days
Current leader · TTFA#1 / 29
51ms
vuivia Fluxions

How models rank on Text prompts

Full TTS dashboard
Time to First Audio on Text promptsMilliseconds · lower is better · 30-day average on this datasetEvery TTS model measured on the Text prompts dataset, ranked on Time to First Audio.
  1. #1vui51 ms
  2. #2Default53 ms
  3. #3Qwen3 TTS Fast70 ms
  4. #4TTS Flash 281 ms
  5. #5Qwen3 TTS 1.7b107 ms
  6. #6Palabra TTS v1118 ms
  7. #7Simba 3.2172 ms
  8. #8TTS 2178 ms
  9. #9Flash v2.5188 ms
  10. #10Simba 3.0193 ms
  11. #11Flux TTS210 ms
  12. #12Mist v3256 ms
Show all 29 models
  1. #13TTS Rt v2262 ms
  2. #14TTS RT v1265 ms
  3. #15Phantom Z 3.4 conversational266 ms
  4. #16Sonic 3.5288 ms
  5. #17Coda295 ms
  6. #18Aura 2303 ms
  7. #19Sonic 3.6328 ms
  8. #20S2.1 Pro344 ms
  9. #21Lightning v3.1 Pro367 ms
  10. #22S1382 ms
  11. #23Grok TTS411 ms
  12. #24Aura 2 En498 ms
  13. #25Chirp 3 HD541 ms
  14. #26Falcon 2545 ms
  15. #27Qwen3 TTS Flash Realtime641 ms
  16. #28GPT-4o mini TTS1011 ms
  17. #29S2.1 Pro Free1389 ms
median of all models · 266 ms
TTS models on the Text prompts dataset over the last 30 days, ranked on Time to First Audio.
#ModelHostTTFAWERSamples
1vuiFluxions51 ms4,737
2Gradium TTS Beta 202609Gradium53 ms4,050
3Qwen3 TTS FastNari Labs70 ms4,727
4TTS Flash 2Inworld AI81 ms4,740
5Qwen3 TTS 1.7bBaseten107 ms391
6Palabra TTS v1Palabra118 ms4,682
7Simba 3.2SpeechifyAI172 ms4,724
8TTS 2Inworld AI178 ms4,737
9Flash v2.5ElevenLabs188 ms4,738
10Simba 3.0SpeechifyAI193 ms4,729
11Flux TTSDeepgram210 ms4,738
12Mist v3Rime256 ms4,740
13TTS Rt v2Soniox262 ms3,086
14TTS RT v1Soniox265 ms3,087
15Phantom Z 3.4 conversationalDeepdub266 ms4,736
16Sonic 3.5Cartesia288 ms4,740
17CodaRime295 ms4,740
18Aura 2Deepgram303 ms4,739
19Sonic 3.6Cartesia328 ms4,740
20S2.1 ProFish Audio344 ms4,739
21Lightning v3.1 ProSmallest367 ms4,740
22S1Fish Audio382 ms4,740
23Grok TTSSpaceXAI411 ms4,727
24Aura 2 EnCloudflare498 ms470
25Chirp 3 HDGoogle541 ms4,740
26Falcon 2Murf545 ms4,739
27Qwen3 TTS Flash RealtimeAlibaba641 ms4,530
28GPT-4o mini TTSOpenAI1011 ms4,715
29S2.1 Pro FreeFish Audio1389 ms4,718
Under-sampled models are excluded; tied models share a place. Dotted WER values split into substitutions, deletions and insertions on hover or tap.

Inside the dataset

30 fixed public inputs — every model is tested on exactly these.

Every prompt in the Text prompts dataset, verbatim from the manifest.
A1Your order #ORD-24589 shipped via UPS tracking 1Z999AA1234567890 and will arrive between 2:30 PM and 4:45 PM tomorrow.
A2There's a slight delay with your $347.89 order, but we expect it to ship by Friday afternoon.
A3Order status update: your items are now in "Quality Check" and should ship within 24-48 hours.
A4Hi Ms. Garcia, your appointment with Dr. Peterson is scheduled for Tuesday, March 5th at 10:30 AM.
A5I can reschedule you to either 11:15 AM on Wednesday or, let me check, 2:45 PM on Thursday.
A6Please arrive 10 minutes early and bring your insurance card and a photo ID.
A7Let's fix your Wi-Fi: unplug your router for exactly 30 seconds, then wait for the green light.
A8Your device is downloading update version 12.4.1, about 250 MB remaining, roughly 8 minutes left.
A9I'm seeing error code E-1047 here, which usually means, actually, let me guide you through the solution.
A10For security, please confirm the last 4 digits of the card ending in 8429 used for your recent purchase.
A11I need to verify your account: what's the ZIP code we have on file? Please take your time.
A12We detected 2 unusual login attempts from Chicago, Illinois yesterday around 11:30 PM.
A13Hi David, your premium subscription renews in 5 days at $29.99, would you like to continue or explore other options?
A14Based on your purchase history, you might like our flash sale: 30% off electronics through Sunday.
A15I noticed you haven't logged in since January 15th, is there anything we can help you with?
A16Your invoice shows a balance of $187.50, including the monthly fee plus tax.
A17The $24.99 charge is for the premium support package you activated on January 22nd.
A18Your auto-payment of $67.50 failed due to an expired card, would you like to update your payment method?
A19Thanks for your interest in our software, companies your size typically see 20-25% efficiency gains.
A20For a 50-person team, I'd recommend our Business plan at $149 per month rather than Basic.
A21Great timing! We're offering 20% off annual plans, that saves you $359.88 for the first year.
A22On a scale of 1 to 10, how would you rate your current pain level?
A23Have you taken any medications today? Please include prescription drugs and over-the-counter items.
A24Your symptoms sound manageable, but I'd recommend seeing Dr. Martinez within 48 hours to be safe.
A25Your PTO request for December 20th through 24th has been approved, that's 3 business days.
A26Password reset complete: your temporary password was sent to your email. Please change it within 24 hours.
A27IT ticket about your printer issue has been assigned to technician Lisa Chen.
A28Your wire transfer of $1,247.50 to account ending in 5691 was processed at 2:15 PM.
A29Hi Mr. O'Connor, I'm calling about your consultation, are you available for 20 minutes between 9 AM and noon?
A30System alert: your server usage hit 87% at 3:42 AM, but it's back to normal levels now.

Source: Coval TTS test cases · License: Apache-2.0

What it tests

Every TTS model synthesizes the same 30 prompts. Time to First Audio measures startup latency on identical text, while transcription-based WER checks whether the generated speech preserves the prompt's words.

Metrics reported for this dataset

Same datasets, prompts and metric definitions for every model, measured by Coval’s open-source runner. Full methodology on the overview.

Evaluate your own voice agent

Use Coval to test your production configuration, prompts and calls—not only the public benchmark endpoints.

Book a Demo