flyworks-avatar-video

name	flyworks-avatar-video
description	Generate videos using Flyworks (a.k.a HiFly) Digital Humans. Create talking photo videos from images, use public avatars with TTS, or clone voices for custom audio.
license	MIT
compatibility	Requires Python 3 and network access to hfw-api.hifly.cc

Avatar Video Generation Skill

This skill allows you to generate videos using Flyworks (a.k.a HiFly 飞影数字人) Digital Humans. Available features:

1. Public Avatar Video: Create video from text or audio using pre-made highly realistic avatars.
2. Talking Photo: Create a "talking photo" video from a single image and text/audio.
3. Voice Cloning: Clone a voice from an audio sample to use in TTS.

For detailed documentation, see the references/ folder:

• authentication.md - API token setup
• avatars.md - Working with avatars
• voices.md - Voice selection and cloning
• video-generation.md - Video creation workflow

API Token & Limitations

This skill works with a default free-tier token, but it has limitations:

• Watermark: Generated videos will have a watermark.
• Duration Limit: Videos are limited to 30 seconds.

To remove limitations:

1. Register at hifly.cc or flyworks.ai.
2. Get your API key from User Settings.
3. Set the environment variable: export HIFLY_API_TOKEN="your_token_here"

Tools

scripts/hifly_client.py

The main entry point for all operations.

Usage

# List available public avatars
python scripts/hifly_client.py list_public_avatars

# List available public voices
python scripts/hifly_client.py list_public_voices

# Create a video with a public avatar (TTS)
python scripts/hifly_client.py create_video --type tts --text "Hello world" --avatar "avatar_id_or_alias" --voice "voice_id_or_alias"

# Create a video with a public avatar (Audio URL or File)
python scripts/hifly_client.py create_video --audio "https://... or path/to/audio.mp3" --avatar "avatar_id_or_alias"

# Create a talked photo video using bundled assets
python scripts/hifly_client.py create_talking_photo --image assets/avatar.png --title "Bundled Avatar"

# Clone a voice using bundled assets
python scripts/hifly_client.py clone_voice --audio assets/voice.MP3 --title "Bundled Voice"

# Check status of generated tasks
python scripts/hifly_client.py check_task --id "TASK_ID"

# Manage local aliases (saved in memory.json)
python scripts/hifly_client.py manage_memory add my_avatar "av_12345"
python scripts/hifly_client.py manage_memory list

Examples

1. Create a simple greeting video

# First find a voice and avatar
python scripts/hifly_client.py list_public_avatars
python scripts/hifly_client.py list_public_voices

# Generate
python scripts/hifly_client.py create_video --type tts --text "Welcome to our service." --avatar "av_public_01" --voice "voice_public_01"

2. Use a custom talking photo

# Create the avatar from an image URL
python scripts/hifly_client.py create_talking_photo --image "https://mysite.com/photo.jpg" --title "CEO Photo"
# Output will give you an Avatar ID, e.g., av_custom_99

# Save it to memory
python scripts/hifly_client.py manage_memory add ceo av_custom_99

# Generate video using the new avatar
python scripts/hifly_client.py create_video --type tts --text "Here is the quarterly report." --avatar ceo --voice "voice_public_01"

Agent Behavior Guidelines

When assisting users with video generation, follow these guidelines:

Voice Selection Required

Video generation requires both text AND a voice. If the user provides text but no voice:

1. Check local memory first: Run manage_memory list to see if the user has saved any voice aliases.

2. Ask the user to choose:

   • "I see you want to create a video with the text '[text]'. Which voice would you like to use?"
   • If they have saved voices: "You have these saved voices: [list]. Or would you prefer a public voice?"
   • If no saved voices: "Would you like to use a public voice, or clone your own voice from an audio sample first?"

3. Help them select:

   • To see public voices: list_public_voices
   • To clone a voice: clone_voice --audio [file] --title [name]

Complete Workflow Example

For a prompt like "Create a talking photo video from my photo saying 'this is my AI twin'":

1. Ask: "Which voice would you like for your AI twin? You can use a public voice or clone your own."
2. If they want to clone: Help them with clone_voice
3. Create the talking photo with both text and voice:

   python scripts/hifly_client.py create_talking_photo \
     --image user_photo.jpg \
     --text "this is my AI twin" \
     --voice SELECTED_VOICE_ID \
     --title "My AI Twin"
   

Saving for Later

After creating avatars or cloning voices, offer to save them:

python scripts/hifly_client.py manage_memory add my_avatar AVATAR_ID --kind avatar
python scripts/hifly_client.py manage_memory add my_voice VOICE_ID --kind voice