Voice AI BenchmarksBy

PROVIDERLAST 30 DAYS

official resource

Smallest.ai voice AI models and benchmarks

Smallest.ai (Smallest, smallest.ai) lists 2 STT and TTS models in Coval. Fastest dated mean latency over 30 days: STT: Pulse at 212 ms TTFS, with 5.3% WER. TTS: Lightning v3.1 Pro at 362 ms TTFA, with 4.4% WER. Last measured .

Smallest.ai develops real-time speech recognition and synthesis.

Measured models
2
STTTTS
Best STT model#16 / 28
212ms
Pulse
Best TTS model#18 / 28
362ms
Lightning v3.1 Pro

Overview

Smallest.ai's Pulse recognizer and Lightning synthesizer are both built and served in-house.

Every model below is measured daily on the same fixed inputs and ranked against the full field, never blended into a company score.

Model lineup

Speech-to-Text
Pulse
Text-to-Speech
Lightning v3.1 Pro

Speech-to-Text

Full STT dashboard

Ranked on Time to Final Segment against 28 measured models.

Time to Final Segmentms · lower is better · Smallest.ai models markedEvery measured STT model on Time to Final Segment, with Smallest.ai's models highlighted.
  1. #1Qwen3 ASR 1.7b39 ms
  2. #2Qwen3 ASR Fast46 ms
  3. #3STT RT v557 ms
  4. #4STT 165 ms
  5. #5Parakeet TDT 0.6B v381 ms
  6. #6Nova 389 ms
  7. #7Nova 292 ms
  8. #16Pulse212 ms
leaders plus Smallest.ai models · 20 other models in the full table
Word Error Rate% · lower is better · Smallest.ai models markedEvery measured STT model on Word Error Rate, with Smallest.ai's models highlighted.
  1. #1Universal 3.5 Pro3.1%
  2. #2Qwen3 ASR Fast3.2%
  3. #3resonant-13.4%
  4. #4Gemini 3.5 Transcribe Live3.9%
  5. #5Chirp 34.1%
  6. #6Qwen3 ASR 1.7b4.1%
  7. #7Enhanced4.3%
  8. #15Pulse5.3%
leaders plus Smallest.ai models · 22 other models in the full table
Time to First Tokenms · lower is better · Smallest.ai models markedEvery measured STT model on Time to First Token, with Smallest.ai's models highlighted.
  1. #1Whisper Large v3via Baseten912 ms
  2. #2Qwen3 ASR 1.7b931 ms
  3. #3Universal 3.5 Pro1040 ms
  4. #4Flux1076 ms
  5. #5Flux Multilingual1163 ms
  6. #6Parakeet TDT 0.6B v31215 ms
  7. #7Whisper Large v3via Together AI1338 ms
  8. #23Pulse2011 ms
leaders plus Smallest.ai models · 18 other models in the full table
TTFS vs WER — Smallest.ai vs every measured modelEach point is one measured STT model · Smallest.ai models highlighted · 30-day averagesTime to Final Segment against Word Error Rate for every measured STT model, with Smallest.ai's models highlighted.
Qwen3 ASR 1.7b — 39 ms, 4.1%Qwen3 ASR Fast — 46 ms, 3.2%STT RT v5 — 57 ms, 5.7%STT 1 — 65 ms, 4.4%Parakeet TDT 0.6B v3 — 81 ms, 11.2%Nova 3 — 89 ms, 6.2%Nova 2 — 92 ms, 7.9%Flux Multilingual — 98 ms, 8.8%Flux — 99 ms, 6.6%Ink 2 — 122 ms, 4.8%Whisper Large v3 via Baseten — 125 ms, 5.6%Scribe v2 Realtime — 133 ms, 5.5%Universal 3.5 Pro — 173 ms, 3.1%Grok STT — 207 ms, 4.6%Default via Speechmatics — 209 ms, 5.4%Default via Gradium — 246 ms, 10.0%resonant-1 — 264 ms, 3.4%Whisper Large v3 via Together AI — 296 ms, 8.5%Enhanced — 299 ms, 4.3%Gemini 3.5 Transcribe Live — 305 ms, 3.9%Voxtral Mini Transcribe Realtime 2602 — 400 ms, 6.2%GPT Realtime Whisper — 551 ms, 5.1%GPT-4o mini Transcribe — 690 ms, 4.9%GPT-4o Transcribe — 754 ms, 4.6%Chirp 3 — 776 ms, 4.1%Solaria 1 — 802 ms, 7.1%Chirp 2 — 873 ms, 4.9%Pulse — 212 ms, 5.3%
Benchmarked models with their Time to Final Segment over the last 30 days.
ModelHostTTFSRank
PulseSmallest212 ms16th of 28

Text-to-Speech

Full TTS dashboard

Ranked on Time to First Audio against 28 measured models.

Time to First Audioms · lower is better · Smallest.ai models markedEvery measured TTS model on Time to First Audio, with Smallest.ai's models highlighted.
  1. #1vui66 ms
  2. #2Qwen3 TTS Fast71 ms
  3. #3TTS Flash 291 ms
  4. #4Qwen3 TTS 1.7b106 ms
  5. #5Palabra TTS v1115 ms
  6. #6TTS 2181 ms
  7. #7Flash v2.5194 ms
  8. #18Lightning v3.1 Pro362 ms
leaders plus Smallest.ai models · 20 other models in the full table
Word Error Rate% · lower is better · Smallest.ai models markedEvery measured TTS model on Word Error Rate, with Smallest.ai's models highlighted.
  1. #1TTS RT v13.9%
  2. #2TTS Rt v24.2%
  3. #3Qwen3 TTS Fast4.2%
  4. #4Eleven v3 Conversational4.4%
  5. #5Lightning v3.1 Pro4.4%
  6. #6Simba 3.24.4%
  7. #7TTS 24.6%
leaders plus Smallest.ai models · 21 other models in the full table
TTFA vs WER — Smallest.ai vs every measured modelEach point is one measured TTS model · Smallest.ai models highlighted · 30-day averagesTime to First Audio against Word Error Rate for every measured TTS model, with Smallest.ai's models highlighted.
vui — 66 ms, 5.5%Qwen3 TTS Fast — 71 ms, 4.2%TTS Flash 2 — 91 ms, 5.4%Qwen3 TTS 1.7b — 106 ms, 5.5%Palabra TTS v1 — 115 ms, 5.8%TTS 2 — 181 ms, 4.6%Flash v2.5 — 194 ms, 6.7%Default — 235 ms, 5.3%TTS Rt v2 — 245 ms, 4.2%TTS RT v1 — 245 ms, 3.9%Mist v3 — 258 ms, 5.6%Sonic 3.5 — 276 ms, 5.9%Phantom Z 3.4 conversational — 286 ms, 6.0%Aura 2 — 308 ms, 5.2%Coda — 312 ms, 5.0%S2.1 Pro — 335 ms, 4.8%Eleven v3 Conversational — 348 ms, 4.4%S1 — 379 ms, 4.9%Grok TTS — 397 ms, 4.9%Sonic 3.6 — 423 ms, 5.3%Simba 3.2 — 452 ms, 4.4%Simba 3.0 — 471 ms, 5.2%Chirp 3 HD — 535 ms, 5.2%Falcon 2 — 545 ms, 5.2%Qwen3 TTS Flash Realtime — 754 ms, 8.9%S2.1 Pro Free — 965 ms, 4.7%GPT-4o mini TTS — 1013 ms, 4.8%Lightning v3.1 Pro — 362 ms, 4.4%
Benchmarked models with their Time to First Audio over the last 30 days.
ModelHostTTFARank
Lightning v3.1 ProSmallest362 ms18th of 28

How fast are Smallest.ai's STT and TTS models?

Pulse measures mean 212 ms time to final segment (16th of 28) among STT systems. Last measured 2026-09-15. Lightning v3.1 Pro measures mean 362 ms time to first audio (18th of 28) among TTS systems. Last measured 2026-09-15.

How accurate are Smallest.ai's STT and TTS models?

Pulse measures 5.3% word error rate (15th of 30) among STT systems. Last measured 2026-09-15. Lightning v3.1 Pro measures 4.4% word error rate (5th of 28) among TTS systems. Last measured 2026-09-15.

Which Smallest.ai model is fastest?

Its fastest dated STT result is Pulse at mean 212 ms time to final segment (16th of 28) among STT systems, with 5.3% WER. Last measured 2026-09-15. Its fastest dated TTS result is Lightning v3.1 Pro at mean 362 ms time to first audio (18th of 28) among TTS systems, with 4.4% WER. Last measured 2026-09-15.

Limits of this comparison

Coval measures Pulse on incoming audio and Lightning v3.1 Pro on fixed text prompts.

  • Coval does not publish one combined Smallest.ai pipeline score or evaluate every voice-cloning capability.

Official resources

Same datasets, prompts and metric definitions for every model, measured by Coval’s open-source runner. Full methodology on the overview.

Evaluate your own voice agent

Use Coval to test your production configuration, prompts and calls—not only the public benchmark endpoints.

Book a Demo