elevenlabs-performance-tuning

Optimize ElevenLabs TTS latency with model selection, streaming, caching, and audio format tuning. Use when experiencing slow TTS responses, implementing real-time voice features, or optimizing audio generation throughput. Trigger with "elevenlabs performance", "optimize elevenlabs", "elevenlabs latency", "elevenlabs slow", "fast TTS", "reduce elevenlabs latency", or "TTS streaming".

Ir a la instalación

Repositorio: jeremylongshore/tons-of-skills-marketplace
Última actividad en el origen: 18 de julio de 2026 a las 00:29
Idioma detectado de SKILL.md: inglés
Estrellas: 2677
Forks: 392

Opciones de instalación

De forma predeterminada está seleccionado el prompt que primero revisa el origen. Puedes cambiar a un comando directo o descargar una copia local.

Revisa los archivos de origen

Lee SKILL.md y los archivos complementarios que muestra SkillsMP antes de decidir si quieres instalarlo.

Volver a la búsqueda Volver a la instalación

name	elevenlabs-performance-tuning
description	Optimize ElevenLabs TTS latency with model selection, streaming, caching, and audio format tuning. Use when experiencing slow TTS responses, implementing real-time voice features, or optimizing audio generation throughput. Trigger with "elevenlabs performance", "optimize elevenlabs", "elevenlabs latency", "elevenlabs slow", "fast TTS", "reduce elevenlabs latency", or "TTS streaming".
allowed-tools	Read, Write, Edit
version	1.6.0
license	MIT
author	Jeremy Longshore <jeremy@intentsolutions.io>
tags	["saas","voice","ai","elevenlabs","performance","optimization"]
compatibility	Designed for Claude Code

ElevenLabs Performance Tuning

Overview

Optimize ElevenLabs TTS latency and throughput through model selection, streaming strategies, audio format tuning, and caching. Latency ranges from ~75ms (Flash) to ~500ms (v3) depending on configuration.

The two highest-leverage, lowest-effort levers — model choice (Step 1) and output format (Step 2) — are documented inline below. The four deeper integrations (HTTP streaming, WebSocket streaming, caching, parallel generation) are summarized here with copy-ready code in the full implementation walkthrough.

Prerequisites

ElevenLabs SDK installed (@elevenlabs/elevenlabs-js)
An ElevenLabs API key exported as ELEVENLABS_API_KEY (used by the SDK and passed as xi_api_key on the WebSocket handshake)
Understanding of your latency requirements
Audio playback infrastructure (browser, mobile, server-side)

Instructions

Step 1: Model Selection for Latency

The single biggest performance lever is model choice:

Model	Avg Latency	Quality	Languages	Use Case
`eleven_flash_v2_5`	~75ms	Good	32	Real-time chat, IVR, gaming
`eleven_turbo_v2_5`	~150ms	Good	32	Balanced speed/quality
`eleven_multilingual_v2`	~300ms	High	29	Narration, content creation
`eleven_v3`	~500ms	Highest	70+	Maximum expressiveness

// Select model based on use case
function selectModel(useCase: "realtime" | "balanced" | "quality" | "max_quality"): string {
   models = {
    :    ,
    :    ,
    :     ,
    : ,
  };
   models[useCase];
}

Format	Size/Second	Quality	Best For
`mp3_44100_128`	~16 KB/s	High	Downloads, archival
`mp3_22050_32`	~4 KB/s	Medium	Streaming, mobile
`pcm_16000`	~32 KB/s	Raw	Server-side processing
`pcm_44100`	~88 KB/s	Raw	High-quality processing
`ulaw_8000`	~8 KB/s	Phone	Telephony/IVR

// Use smaller format for streaming, higher quality for downloads
const streamingConfig = {
  output_format: "mp3_22050_32",  // 4 KB/s — fast streaming
  model_id: "eleven_flash_v2_5",   // ~75ms first byte
};

const downloadConfig = {
  output_format: "mp3_44100_128", // 16 KB/s — high quality
  model_id: "eleven_multilingual_v2",
};

Optimization	Latency Impact	Implementation
Flash model	-60% vs v2, -85% vs v3	Change `model_id`
Streaming endpoint	-50% time-to-first-byte	Use `.stream()` instead of `.convert()`
WebSocket streaming	Best for LLM integration	See Step 4
Smaller output format	-30% transfer time	`mp3_22050_32` vs `mp3_44100_128`
Audio caching	-99% for repeated content	LRU cache with SHA-256 keys
`style: 0`	-10-20% latency	Remove style exaggeration
Concurrency queue	Maximize throughput	p-queue matching plan limit

Issue	Cause	Solution
High TTFB	Wrong model	Switch to `eleven_flash_v2_5`
Choppy streaming	Network buffering	Use `pcm_16000` for direct playback
Cache miss storm	TTL expired for popular content	Use stale-while-revalidate pattern
WebSocket drops	Network instability	Reconnect with buffered text
Memory pressure	Audio cache too large	Set `maxSize` limit on LRU cache
HTTP 429	Concurrency above plan limit	Lower `p-queue` `concurrency`

await streamToResponse(greeting, voiceId, res); // logs "Time to first byte: 78ms"

const stream = await createTTSStream({ voiceId, chunkLengthSchedule: [50, 100, 150] });
stream.sendText("Hello, "); stream.sendText("how are you?");
const audio = await stream.finish();

const buffers = await generateChapters(chapters, voiceId); // 5-wide, cache-backed