| name | control-media-playback |
| description | Play, pause, seek, and adjust audio or video, and react to transport controls. Use for "play some music", "pause", "skip ahead 30 seconds", "turn it up", or "play that video". Triggers: play, pause, resume, stop, skip, seek, rewind, volume, louder, quieter, next track, music, video. |
| license | MIT |
| compatibility | Requires JarvisVR agent-backend. Media sources resolve via the configured provider; offline uses sample media. |
| metadata | {"agent":"media-agent","category":"media","version":"1.0","author":"jarvisvr"} |
| allowed-tools | play_media show_music_visualizer |
Control Media Playback
Drive a media_player (and, for music, an optional music_visualizer) and
handle its transport events.
Steps
- Resolve the source. A named track/video → resolve a
source_url +
media_type (audio|video). "Play music" with no title → a default playlist.
- Start with
play_media. Spawns a media_player (state:"playing").
- For music, add ambience with
show_music_visualizer (audio-reactive).
- Handle controls (
client.interaction, §5.11) with holo.update:
play_pause → toggle state.seek{position_ms} → set position_ms.set_volume{volume} → set volume (0–1).stop → state:"stopped" or holo.destroy.
- Map speech to actions: "turn it up" →
volume += 0.1; "skip 30s" →
position_ms += 30000.
Output
media_player (play_media, props per registry.json):
{ "widget_type": "media_player",
"transform": { "anchor": "world", "billboard": true },
"props": { "title": "Lo-fi Beats", "source_url": "https://cdn.jarvisvr.app/audio/lofi.mp3",
"media_type": "audio", "state": "playing", "position_ms": 0,
"duration_ms": 180000, "volume": 0.6, "loop": true },
"interactions": ["tap","grab","resize","slider"] }
music_visualizer (show_music_visualizer):
{ "widget_type": "music_visualizer",
"props": { "track": "Lo-fi Beats", "artist": "Chillhop", "style": "bars",
"amplitude": [0.2,0.6,0.9,0.4,0.7], "color": "#7FE7FF", "playing": true } }
Edge cases
- Source not found → say so; offer alternatives, don't fabricate a URL.
- Nothing playing ("pause") → no-op with a gentle note.
- Volume bounds → clamp to 0.0–1.0.
- Video vs audio → video uses a larger
world-anchored player; keep it out of
the user's path (defer placement to stage-agent).
- Ambient background loop (rain, café) → that's
set-soundscape.
- Generate cover art / imagery →
create-image.
