understand-three-view-images

name	understand-three-view-images
description	Skill for understanding RGB images from three cameras. Trigger when the user mentions "understand images" or "understand the environment".

understand-three-view-images

This skill understands images from the robot head, left-arm, and right-arm cameras. It auto-captures view images, runs a multimodal model, and returns an environment understanding result.

Before running, set ARK_API_KEY (or VOLCENGINE_API_KEY) and source $ZERO2SKILL_ROOT/configs/paths.env.

Capabilities

• Understand three-view / front-view image content and return current environment understanding
• BBox prompt variant: scripts/auto_understand_images_bbox.sh

Workflow

Use scripts/auto_understand_images.sh --prompt "Please describe the current desktop scene" to get environment understanding. The script auto-captures images and calls the understanding script.

File layout

understand-three-view-images/
├── SKILL.md
└── scripts/
     ├── auto_understand_images.sh
     ├── auto_understand_images_bbox.sh
     ├── capture_and_understand_one_view.py
     └── ...

Resources

• scripts/auto_understand_images.sh: capture and understand; requires --prompt