Skip to main content

camera-describe

Use when the user asks what the robot sees, requests a photo or snapshot, wants a description of the surroundings, asks about objects in view, or says "look at X", "what's in front of you", "describe your environment", "take a picture", "scan the area", "can you see X", "show me what you see".

Ir para a instalação

Informações da origem

Repositório
craigm26/OpenCastor
Última atividade na origem
17 de março de 2026 às 18:41
Idioma detectado do SKILL.md
inglês
Estrelas
28
Forks
5

Opções de instalação

Por padrão, está selecionado o prompt que primeiro revisa a origem. Você pode mudar para um comando direto ou baixar uma cópia local.

Revise os arquivos de origem

Leia o SKILL.md e os arquivos complementares exibidos pelo SkillsMP antes de decidir se vai instalar.

Explorador de arquivos
2 arquivos

Exibindo SKILL.md

SKILL.md
Instruções da origem · Visualização somente leitura
name
camera-describe
description
Use when the user asks what the robot sees, requests a photo or snapshot, wants a description of the surroundings, asks about objects in view, or says "look at X", "what's in front of you", "describe your environment", "take a picture", "scan the area", "can you see X", "show me what you see".
version
1.1
requires
["vision"]
consent
none
tools
["get_camera_frame","get_distance"]
max_iterations
2
# Camera Describe Skill Capture and describe what the robot's camera sees. ## Steps 1. Call `get_camera_frame()` to capture a JPEG snapshot 2. If depth sensor available, call `get_distance()` to get nearest obstacle distance 3. Describe the scene naturally: objects, colours, layout, notable features 4. Include distance context: "The nearest object is approximately X metres away" 5. Note any obstacles within 1 metre as a safety observation ## If camera unavailable Return: "My camera is not currently available. I can describe my sensor readings instead if helpful." ## Guidelines - Be specific about what you see — avoid vague descriptions like "some objects" - Mention spatial relationships: "to the left", "in the centre", "in the background" - If asked about a specific object, focus your description on finding it - Do not fabricate visual content if the frame is blank or unavailable - For object identification questions ("is there a cup?"), scan carefully before answering ## References See `references/scene-description-guide.md` for spatial vocabulary and lighting callouts. ## Gotchas - **Blank/black frame ≠ nothing there** — camera may need a moment to warm up; retry once before reporting unavailable - **Depth sensor returns 0.0** — means out-of-range (> sensor max), not "right in front of you"; treat 0.0 as "no valid reading" - **OAK-D proxy latency** — first frame after startup can take 2–3s; if `get_camera_frame()` is slow, still wait for it rather than aborting - **Confusing left/right** — camera's left is the user's right if facing the robot; always describe from the camera's perspective, not the user's - **Low light** — if the description would be "dark room, can't see much", also report any distance readings as supplementary info ## Example User: "What do you see?" → `get_camera_frame()` → `get_distance()` → "I can see a wooden table in the foreground with several Lego bricks scattered on it. The nearest object is approximately 0.4 metres away. In the background there's a white wall."
Ver no GitHub