nemotron-speech

name	nemotron-speech
description	Routes NVIDIA Nemotron Speech (Riva) NIM tasks — deploys, runs, and tests ASR, TTS, and NMT NIMs on build.nvidia.com or self-hosted.
triggers	["Nemotron Speech","deploy Riva NIM","deploy ASR/TTS/NMT NIM","Riva ASR","Riva TTS","Riva translation","Parakeet","Canary","Whisper","Nemotron ASR Streaming","Magpie TTS","DNT tag","nemo2riva","riva-build","riva-deploy","RMIR","Riva NIM setup","NGC API key","force_eou","Silero VAD","Sortformer diarization","chunk size Riva","Riva HTTP","Riva WebSocket","grpc.nvcf.nvidia.com","build.nvidia.com Riva","custom TTS model","fine-tuned TTS","zero-shot TTS","zero-shot voice cloning","TTS pronunciation dictionary","SSML Riva","exaggeration_factor","OGG_OPUS TTS","TTS pipeline configuration","IPA pronunciation TTS","phoneme Riva TTS","custom TTS pronunciation","mispronounced word TTS","how to pronounce Riva TTS","TTS IPA candidates"]
version	1.0.0
license	Apache-2.0
metadata	{"author":"Nemotron Speech Team","team":"riva","tags":["nvidia","nemotron-speech","riva","nim","asr","tts","nmt","speech","speech-to-text","text-to-speech","translation","parakeet","canary","whisper","magpie","nemotron","grpc","http","websocket","cloud","nvcf","pronunciation","ipa","phoneme"],"domain":"ml"}

Nemotron Speech Skills

Note: "Nemotron Speech" is the public-facing name for what NVIDIA documents today as Riva / Riva NIM. All commands, container images, gRPC APIs, Python imports, and documentation URLs still use "Riva" — the rename is brand-only. Do not rename commands, images, or doc URLs.

Agent: When walking the user through a multi-step workflow, announce each step before presenting it: Step N/M — Step Title (e.g., "Step 1/4 — Deploy the Container").

Purpose

Single entry point for all NVIDIA Nemotron Speech (Riva) NIM workflows: ASR (speech-to-text), TTS (text-to-speech), and NMT (translation). Covers cloud-hosted inference via build.nvidia.com, self-hosted Docker deployment, client-protocol choice for ASR (gRPC, HTTP, WebSocket), custom NeMo model deployment via riva-build, ASR pipeline tuning (VAD, diarization, language models), and the prerequisite Docker / NGC / driver setup.

When to Use This Skill

Use this skill for any Nemotron Speech / Riva NIM task — deployment, testing, custom model build, system requirements check, or model selection across ASR / TTS / NMT modalities.

Workflow

Identify the user's task type, then load the corresponding reference file from references/. The reference files contain the detailed per-workflow content; this SKILL.md is a routing surface. Load only the reference relevant to the task at hand.

Prerequisites

• For self-hosted deployment: NVIDIA AI Enterprise (NVAIE) entitlement, then complete the environment setup — NVIDIA drivers, Docker, Container Toolkit, NGC API key, Riva Python client. See references/setup.md.
• For cloud-hosted inference: pip install -U nvidia-riva-client and a valid NVIDIA_API_KEY from https://build.nvidia.com.
• Treat NVIDIA_API_KEY and NGC_API_KEY as secrets: never print, paste, commit, or log real key values. Prefer --password-stdin for Docker login and store persistent keys in a credential manager or a chmod 600 env file rather than world-readable shell startup files.
• For self-hosted Docker model caching: host directories mounted at /opt/nim/.cache must be writable by the container user (the NIM container runs as nvs:1000 internally), not just the host user. Run after creating the directory so the container can write to it. Avoid world-writable modes — they let any local user replace cached model artifacts. Also avoid on the docker run — inside the container isn't writable to arbitrary UIDs. If you see during model download, the host directory ownership is the issue.