pi-codex-computer-use

name	pi-codex-computer-use
description	Use Pi's Open Computer Use / Codex-style computer-use tools to inspect and operate local GUI apps through Accessibility/Screen Recording. Use when a task needs desktop app state, clicking, typing, scrolling, or Codex Computer Use from Pi.
disable-model-invocation	true

Pi Codex Computer Use

This package exposes Open Computer Use as Pi tools with the computer_use_ prefix.

Workflow

1. If permissions or connection are unknown, run computer_use_status or computer_use_doctor.
2. Use computer_use_list_apps to discover app names.
3. Call computer_use_get_app_state before every action turn. Use show_full_text: true for long chat/email/document text.
4. Prefer element indexes from the latest app state.
5. Use coordinate click/drag only when the accessibility tree does not expose a safer target.
6. Use computer_use_sequence for short multi-step flows that need to reuse the same snapshot and element indexes.
7. Ask before sending, deleting, purchasing, approving prompts, uploading files, or interacting with password managers/sensitive apps.

Tools

• computer_use_list_apps({})
• computer_use_get_app_state({ app, show_full_text? })
• computer_use_click({ app, element_index? , x?, y?, click_count?, mouse_button? })
• computer_use_perform_secondary_action({ app, element_index, action })
• computer_use_scroll({ app, element_index, direction, pages? })
• computer_use_drag({ app, from_x, from_y, to_x, to_y })
• computer_use_type_text({ app, text })
• computer_use_press_key({ app, key })
• computer_use_set_value({ app, element_index, value })
• computer_use_sequence({ calls })

Human commands

• /ocu-doctor checks permissions and opens macOS onboarding if needed.
• /ocu-status reports connection and command resolution.
• /ocu-open [command] reconnects to a specific open-computer-use binary.
• /ocu-close shuts the MCP child process down.