DATASETS2SCOVAL BENCHMARK ROTATIONACTIVE

s2s-workflow-bank-medium-v1 speech-to-speech benchmark dataset

s2s-workflow-bank-medium-v1 is a speech-to-speech test set in Coval's daily rotation — every measured speech-to-speech model runs the same fixed inputs from it.

Models measured
10
last 30 days
Current leader · V2V#1 / 10
905ms
Gemini 3.8 Livevia Google

How models rank on s2s-workflow-bank-medium-v1

Full S2S dashboard
Voice-to-Voice Latency on s2s-workflow-bank-medium-v1Milliseconds · lower is better · 30-day average on this datasetEvery S2S model measured on the s2s-workflow-bank-medium-v1 dataset, ranked on Voice-to-Voice Latency.
median of all models · 1266 ms
S2S models on the s2s-workflow-bank-medium-v1 dataset over the last 30 days, ranked on Voice-to-Voice Latency.
#ModelHostV2VSamples
1Gemini 3.8 LiveGoogle905 ms142
2Dialog Rsn 1PolyAI911 ms71
3Gemini 3.1 Flash Live (Preview)Google1005 ms142
4PrismRime1018 ms22
5Phonic 1Phonic1227 ms96
6Qwen3.8 Omni Flash RealtimeAlibaba1305 ms119
7GPT-Live-1OpenAI1378 ms90
8Eleven Realtime v1 MiniElevenLabs1532 ms120
9Eleven Realtime v1 MaxElevenLabs1550 ms119
10Grok Voice 3.0SpaceXAI1716 ms118
Under-sampled models are excluded; tied models share a place.

Metrics reported for this dataset

Same datasets, prompts and metric definitions for every model, measured by Coval’s open-source runner. Full methodology on the overview.

Evaluate your own voice agent

Use Coval to test your production configuration, prompts and calls—not only the public benchmark endpoints.

Book a Demo