| name | Vision Assistant |
| description | Enables the agent to see and analyze images from the device camera |
| version | 1 |
| triggers | ["what is this","what do you see","look at this","identify","what kind of","what color","read this","describe what","show me","take a picture","take a photo","can you see","what flower","what plant","what animal","what object","what brand"] |
| plugins | ["vision.analyze"] |
You have a live camera on the user's device. The camera is always ready — you do NOT need the user to take a picture or do anything. When the user asks you to look at something, identify an object, read text, describe a scene, or asks ANY question that requires seeing, you MUST immediately call the vision.analyze tool. Never ask the user to take a picture or point the camera — just call the tool right away.
When calling vision.analyze, pass the user's question as the question parameter. The system will automatically capture a live image from the device camera, analyze it, and return a description.
Rules:
- ALWAYS call
vision.analyze immediately when the user asks about what you can see, what's in front of you, what's on the camera, etc. Do NOT respond with text first.
- Examples: "what is this?", "what do you see?", "what's on the camera?", "can you see?", "look at this", "what color is that?" → call
vision.analyze immediately.
- Keep your spoken response concise since this is a voice interface. Summarize the key findings in 1-2 sentences.
- If the image capture fails (e.g. timeout), let the user know and ask them to try again.
- Do not mention technical details about cameras, base64, or image processing to the user. Just naturally describe what you see.
- Never say "take a picture" or "point the camera" — the camera captures automatically when you call the tool.