| name | translating-videos |
| description | Translates videos including subtitles, voice cloning, and lip sync. Use when user wants to translate video, dub video to another language, convert video language, localize video content, create multilingual video, add translated voiceover, change video audio language, or produce foreign language version. 视频翻译、配音翻译、字幕翻译、视频本地化、多语言视频、翻译视频、视频配音、语言转换。 |
Video Translation
Translates video content to another language using AI voice cloning, lip sync, and subtitle translation.
When to Use
Use this skill when:
- Translating video content to another language
- Creating dubbed versions of videos
- Adding translated voiceover
- Localizing video for different markets
- Converting Chinese videos to English (or vice versa)
Features
- AI Voice Cloning: Preserves original speaker's voice characteristics
- Emotion Preservation: Maintains emotional tone in translated audio
- Lip Sync: Adjusts lip movements to match translated audio
- Subtitle Translation: Automatically translates hardcoded subtitles
Workflow
Step 1: Get Source Video
Obtain the video URL that needs translation.
Step 2: Submit Translation Task
Call submitAideoTask with:
- prompt: Specify target language and translation requirements
- multiInputs: Array containing source video URL
Step 3: Poll for Results
- First check: Wait 210 seconds after submission
- Subsequent checks: Wait 30 seconds between polls
- Call
getAideoTaskStatus to check progress
Step 4: Timeout Handling
Maximum wait time: 20 minutes
If task exceeds 20 minutes, report as timeout failure.
Step 5: Return Results
On completion, return the translated video URL.
Examples
Example 1: Chinese to English
User request: "Translate this Chinese video to English"
submitAideoTask:
prompt: "Translate this Chinese video to English, including subtitle translation and voice dubbing with emotion preservation"
multiInputs: ["chinese_video.mp4"]
Example 2: English to Japanese
User request: "Create a Japanese version of this video"
submitAideoTask:
prompt: "Translate this English video to Japanese with natural voice cloning and lip sync"
multiInputs: ["english_video.mp4"]
Example 3: Multi-language Localization
User request: "I need this video in Spanish"
submitAideoTask:
prompt: "Translate this video to Spanish with dubbed audio and translated subtitles"
multiInputs: ["source_video.mp4"]
Supported Languages
- Chinese (Mandarin)
- English
- Japanese
- Korean
- Spanish
- And more...
Important Notes
- Processing time varies based on video length
- Voice cloning quality depends on source audio quality
- Maximum wait time is 20 minutes
- Works best with clear audio and minimal background noise
