Voice AI BenchmarksBy

PROVIDERLAST 30 DAYS

Out of Set voice AI models and benchmarks

Out of Set lists 1 TTS model in Coval. Its fastest dated TTS result is Airy TTS at mean 270 ms time to first audio (18th of 32) among TTS systems, with 1.6% WER. Results cover the last 30 days. Last measured .

Coval measures voice models created or hosted by Out of Set.

Measured models
1
TTS
Best TTS model#18 / 32
270ms
Airy TTS

Overview

Every model below is measured daily on the same fixed inputs and ranked against the full field, never blended into a company score.

Model lineup

Text-to-Speech
serves Airy TTS

Text-to-Speech

Full TTS dashboard

Ranked on Time to First Audio against 32 measured models.

Time to First Audioms · lower is better · Out of Set models markedEvery measured TTS model on Time to First Audio, with Out of Set's models highlighted.
  1. #1vui56 ms
  2. #2Default63 ms
  3. #3Qwen3 TTS Fast68 ms
  4. #4TTS Flash 285 ms
  5. #5Qwen3 TTS 1.7b106 ms
  6. #6Simba 3.0110 ms
  7. #7Palabra TTS120 ms
  8. #18Airy TTS270 ms
leaders plus Out of Set models · 24 other models in the full table
Word Error Rate% · lower is better · Out of Set models markedEvery measured TTS model on Word Error Rate, with Out of Set's models highlighted.
  1. #1Sonic 3.61.5%
  2. #2Sonic 3.51.6%
  3. #3S2.1 Pro Free1.6%
  4. #4Lightning v3.1 Pro1.6%
  5. #5S2.1 Pro1.6%
  6. #6Simba 3.01.6%
  7. #7Chirp 3 HD1.6%
  8. #8Airy TTS1.6%
leaders plus Out of Set models · 24 other models in the full table
TTFA vs WER — Out of Set vs every measured modelEach point is one measured TTS model · Out of Set models highlighted · 30-day averagesTime to First Audio against Word Error Rate for every measured TTS model, with Out of Set's models highlighted.
vui — 56 ms, 2.1%Default — 63 ms, 1.9%Qwen3 TTS Fast — 68 ms, 1.9%TTS Flash 2 — 85 ms, 1.7%Qwen3 TTS 1.7b — 106 ms, 1.9%Simba 3.0 — 110 ms, 1.6%Palabra TTS — 120 ms, 2.7%Simba 3.2 — 129 ms, 2.0%drama3-preview — 175 ms, 1.8%TTS 2 — 182 ms, 1.7%Flash v2.5 — 194 ms, 1.9%Eleven v4 Turbo — 197 ms, 1.7%Flux TTS — 204 ms, 1.7%Phantom Z 3.4 conversational — 241 ms, 2.2%TTS RT v1 — 256 ms, 2.5%TTS Rt v2 — 257 ms, 2.4%Falcon 2 — 264 ms, 1.7%Mist v3 — 287 ms, 2.1%Sonic 3.5 — 290 ms, 1.6%Sonic 3.6 — 295 ms, 1.5%Aura 2 — 298 ms, 1.9%Coda — 332 ms, 9.5%S2.1 Pro — 347 ms, 1.6%Grok TTS — 356 ms, 1.7%Lightning v3.1 Pro — 394 ms, 1.6%Daytona TTS — 485 ms, 1.7%Aura 2 En — 559 ms, 2.1%Chirp 3 HD — 597 ms, 1.6%Qwen3 TTS Flash Realtime — 720 ms, 3.1%S2.1 Pro Free — 844 ms, 1.6%GPT-4o mini TTS — 2549 ms, 1.8%Airy TTS — 270 ms, 1.6%
Benchmarked models with their Time to First Audio over the last 30 days.
ModelHostTTFARank
Airy TTSOut of Set270 ms18th of 32

How fast are Out of Set's TTS models?

Airy TTS measures mean 270 ms time to first audio (18th of 32) among TTS systems. Last measured 2026-10-19.

How accurate are Out of Set's TTS models?

Airy TTS measures 1.6% word error rate (8th of 32) among TTS systems. Last measured 2026-10-19.

Which Out of Set model is fastest?

Its fastest dated TTS result is Airy TTS at mean 270 ms time to first audio (18th of 32) among TTS systems, with 1.6% WER. Last measured 2026-10-19.

Same datasets, prompts and metric definitions for every model, measured by Coval’s open-source runner. Full methodology on the overview.

Evaluate your own voice agent

Use Coval to test your production configuration, prompts and calls—not only the public benchmark endpoints.

Book a Demo