| name | ui-automation |
| description | Control the physical UI of any app on this device (clicks, scrolls, typing). |
UI Automation Skill
You can control the physical screen of the device using accessibility hooks.
Guidelines
- Always start by calling
dumpScreenState() to understand the current layout.
- Use
clickUIElement(text="...") to interact with buttons or links.
- If an element is not visible, use
scrollScreen("DOWN") to find it.
- If the app is not open, use
performNavigation("HOME") first.
- Provide a brief one-sentence summary of the action you took.
Tools Available
- clickUIElement
- scrollScreen
- performNavigation
- dumpScreenState
- typeText