Menu
Operate apps on the desktop host the user connected to Zero Computer Use, when APIs are not enough. Not for remote browser sessions, which are Zero Browser (`zero browser use`).
Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.
Based on SOC occupation classification
Create, edit, inspect, run, schedule, pause, or delete Zero workflows and automations.
Google Slides API for reading and editing presentations and speaker notes. Use when user mentions "Google Slides", "slides", "presentation", "speaker notes", or shares a docs.google.com/presentation link.
Use vm0's managed banking gateway backed by Finicity to list enabled bank accounts, balances, and transactions. Use when the user mentions Finicity, connected bank accounts, banking balances, or bank transactions.
Reconcile accounts, ledgers, bank statements, subledgers, variances, and supporting schedules.
Quality-check data analysis for joins, metrics, denominators, date ranges, leakage, and statistical pitfalls.
Prepare audit workpapers, control tests, samples, evidence, deficiencies, and remediation tracking.
| name | computer-use |
| description | Operate apps on the desktop host the user connected to Zero Computer Use, when APIs are not enough. Not for remote browser sessions, which are Zero Browser (`zero browser use`). |
Use npx -p @vm0/cli zero computer-use <command> to inspect and operate apps on the connected Zero Desktop host. Treat it as an accessibility-first GUI control surface: read the app state, act through accessibility elements, and inspect screenshots only when visual information is required or the accessibility state is insufficient.
--app accepts an app bundle id only, such as com.apple.Safari or com.google.Chrome. App names like Safari, Google Chrome, Slack, or WeChat are display labels only and must not be passed to --app.
bundleId:npx -p @vm0/cli zero computer-use list-apps
Use the name field only to identify the app for yourself, then copy the bundleId field. Apps listed without a bundleId cannot be targeted.
app_bundle_id="com.apple.Safari"
npx -p @vm0/cli zero computer-use open-app --app "$app_bundle_id" --timeout 10
npx -p @vm0/cli zero computer-use get-app-state --app "$app_bundle_id" --timeout 10
snapshotId is required for follow-up actions against the same state.appState is expected to be a local file path containing the full accessibility tree. Read or filter that file to find element indexes, roles, labels, URLs, and the focused element.screenshot is a local image path under /tmp/vm0/computer-use/.... Do not inspect it by default; use the image viewer only when visual judgment matters or the accessibility tree does not expose a usable target.appState as an inline string. If it is not a path, save the JSON output to a temp file and extract/filter the inline string.npx -p @vm0/cli zero computer-use click --app "$app_bundle_id" --snapshot-id <snapshotId> --element-index <index>
npx -p @vm0/cli zero computer-use set-value --app "$app_bundle_id" --snapshot-id <snapshotId> --element-index <index> --value "text"
npx -p @vm0/cli zero computer-use type-text --app "$app_bundle_id" --snapshot-id <snapshotId> --text "literal text"
npx -p @vm0/cli zero computer-use press-key --app "$app_bundle_id" --snapshot-id <snapshotId> --key Command+L
npx -p @vm0/cli zero computer-use scroll --app "$app_bundle_id" --snapshot-id <snapshotId> --element-index <index> --direction down --pages 1
If a post-action command returns a new snapshotId and appState, use that new snapshot. Otherwise, explicitly run get-app-state again before choosing the next element index or coordinate.
appState accessibility tree. For routine forms, buttons, lists, links, and navigation, do not inspect the screenshot when accessibility roles and labels provide enough information to act safely.appState before falling back to the screenshot.list-apps before targeting an app unless you already know the exact bundle id from the same host.bundleId value to --app.Slack, Safari, Google Chrome, or WeChat to --app.app_not_found and the --app value looks like a name, re-run list-apps, find the app record, and retry with its bundleId.bundleId in list-apps, report that it is not targetable through Computer Use.To search the list-apps output for a likely target:
apps_json=/tmp/computer-use-apps.json
npx -p @vm0/cli zero computer-use list-apps > "$apps_json"
node -e "const fs=require('fs'); const q=(process.argv[2]||'').toLowerCase(); const apps=JSON.parse(fs.readFileSync(process.argv[1],'utf8')).apps || []; for (const a of apps) { if (!q || String(a.name || '').toLowerCase().includes(q)) console.log([a.name || '', a.bundleId || 'NO_BUNDLE_ID', a.running ? 'running' : 'not running'].join('\t')); }" "$apps_json" "Slack"
Copy the exact bundleId from the matching row into app_bundle_id.
Accessibility trees can be very large. Prefer the appState file returned by the command:
app_bundle_id="com.apple.Safari"
state_json=/tmp/computer-use-state.json
npx -p @vm0/cli zero computer-use get-app-state --app "$app_bundle_id" --timeout 10 > "$state_json"
app_state_path=$(node -e "const fs=require('fs'); const r=JSON.parse(fs.readFileSync(process.argv[1],'utf8')); console.log(r.appState)" "$state_json")
rg -n "Ethan|showcase|sites\\.vm0|Send now" "$app_state_path"
If the CLI still returns inline app state instead of a path, use the transition workaround:
state_json=/tmp/computer-use-state.json
npx -p @vm0/cli zero computer-use get-app-state --app "$app_bundle_id" --timeout 10 > "$state_json"
node -e "const fs=require('fs'); const s=JSON.parse(fs.readFileSync(process.argv[1],'utf8')).appState; s.split('\\n').forEach((l,i)=>{ if(/Ethan|showcase|sites\\.vm0|Send now/.test(l)) console.log((i+1)+': '+l) })" "$state_json"
Use filtered output to locate clickable link, button, text field, checkbox, or outline row entries and their element indexes.
get-app-state and follow-up actions against that snapshot.--element-index or --element over coordinate clicks.--x/--y only when the screenshot clearly shows the target but the accessibility tree has no useful element.--snapshot-id from the state used to pick the element or coordinate.open-app --app <bundleId> when the app is not visible or not running.press-key for reliable shortcuts such as Command+L, Command+T, Command+W, Enter, and arrow keys.type-text only after confirming focus is in the right field.type-text fails with element_not_editable, click into a text field first or use set-value on a settable text field.After clicking a link from another app:
list-apps to find the browser bundle id, such as com.apple.Safari, com.google.Chrome, or the Arc bundle id returned by the host.appState for the address field, page title, links, controls, and focused element.press-key --app <browserBundleId> --snapshot-id <snapshotId> --key Command+L plus type-text and Enter when direct navigation is faster than finding a link.app_not_found: check whether --app was a display name. If so, retry with the app's bundleId from list-apps. If it was already a bundle id, the app may not be installed, not running, or not targetable on the host.window_unavailable: try open-app --app <bundleId>, then run get-app-state again. If it still fails, report that the app has no controllable window.element_not_editable: click into the target text field, re-read state, then use type-text; or use set-value when a settable text field is available.permission_denied, accessibility_unavailable, or screen_recording_unavailable: report the missing Desktop permission instead of retrying the same command.State what was actually done through Computer Use: apps inspected by bundle id, whether screenshot fallback was needed, and whether actions succeeded. If a desktop action times out or the host is unavailable, say that directly and use a stable fallback only when it still satisfies the user request.