Open Brain
VercelEngineering PostOfficial Source

ElevenLabs on AI Gateway

Vercel AI Gateway adds 14 ElevenLabs models across transcription, realtime voice, music, effects, and dialogue under one API key, with shared cost and trace views. Realtime models use semantic VAD, not server VAD.

Vercel · Oct 27, 2026
Open Source Open MarkdownOpen JSON
Source Summary

AI Gateway adds **14 ElevenLabs models** across six audio types: transcription, streaming speech, realtime voice, music, sound effects, and multi-voice dialogue. Requests share one gateway key and common usage, cost, and trace views. Realtime voice models use one WebSocket session; the streaming pipeline can instead keep transcription, language, and speech models swappable.

Practical Implication

Builders can choose between a modular speech pipeline and a single realtime model, and route audio alongside other models through the same gateway. Browser realtime setup requires a short-lived token, and the models support **semantic VAD** but not server VAD.

Agent-Ready Context
AI Gateway adds **14 ElevenLabs models** across six audio types: transcription, streaming speech, realtime voice, music, sound effects, and multi-voice dialogue. Requests share one gateway key and common usage, cost, and trace views. Realtime voice models use one WebSocket session; the streaming pipeline can instead keep transcription, language, and speech models swappable.

Builders can choose between a modular speech pipeline and a single realtime model, and route audio alongside other models through the same gateway. Browser realtime setup requires a short-lived token, and the models support **semantic VAD** but not server VAD.

The listed 50% discount runs through **November 9**. The material does not provide comparative latency, quality, or cost results, so model selection still needs workload-specific evaluation.
Connected Context · Feed7 Judgment

This expands AI Gateway audio from individual speech routes to a broad ElevenLabs menu spanning transcription, realtime voice, music, effects, and dialogue. It also makes the architecture choice explicit: use one realtime session or keep transcription, language, and speech models swappable. The shared gateway provides common usage and trace views, but the source gives no comparative results for choosing a model.

Context Map
infraaudio#gateways#observability#model-selection
Uncertainty
The listed 50% discount runs through **November 9**. The material does not provide comparative latency, quality, or cost results, so model selection still needs workload-specific evaluation.