pi-codex-computer-use
Use Pi's Open Computer Use / Codex-style computer-use tools to inspect and operate local GUI apps through Accessibility/Screen Recording. Use when a task needs desktop app state, clicking, typing, scrolling, or Codex Computer Use from Pi.
来源信息
- 仓库
- joelhooks/pi-codex-computer-use
- 最近来源活动
- 2026年8月9日 19:11
- 检测到的 SKILL.md 语言
- 英语
- 星标
- 0
- Forks
- 0
安装方式
默认使用会先检查来源的 Prompt;你也可以切换为直接命令,或下载本地副本。
检查来源文件
决定是否安装前,请先阅读 SKILL.md,以及 SkillsMP 当前展示的配套文件。
正在显示 SKILL.md
SKILL.md
来源说明 · 只读预览- name
- pi-codex-computer-use
- description
- Use Pi's Open Computer Use / Codex-style computer-use tools to inspect and operate local GUI apps through Accessibility/Screen Recording. Use when a task needs desktop app state, clicking, typing, scrolling, or Codex Computer Use from Pi.
- disable-model-invocation
- true
# Pi Codex Computer Use
This package exposes Open Computer Use as Pi tools with the `computer_use_` prefix.
## Workflow
1. If permissions or connection are unknown, run `computer_use_status` or `computer_use_doctor`.
2. Use `computer_use_list_apps` to discover app names.
3. Call `computer_use_get_app_state` before every action turn. Use `show_full_text: true` for long chat/email/document text.
4. Prefer element indexes from the latest app state.
5. Use coordinate click/drag only when the accessibility tree does not expose a safer target.
6. Use `computer_use_sequence` for short multi-step flows that need to reuse the same snapshot and element indexes.
7. Ask before sending, deleting, purchasing, approving prompts, uploading files, or interacting with password managers/sensitive apps.
## Tools
- `computer_use_list_apps({})`
- `computer_use_get_app_state({ app, show_full_text? })`
- `computer_use_click({ app, element_index? , x?, y?, click_count?, mouse_button? })`
- `computer_use_perform_secondary_action({ app, element_index, action })`
- `computer_use_scroll({ app, element_index, direction, pages? })`
- `computer_use_drag({ app, from_x, from_y, to_x, to_y })`
- `computer_use_type_text({ app, text })`
- `computer_use_press_key({ app, key })`
- `computer_use_set_value({ app, element_index, value })`
- `computer_use_sequence({ calls })`
## Human commands
- `/ocu-doctor` checks permissions and opens macOS onboarding if needed.
- `/ocu-status` reports connection and command resolution.
- `/ocu-open [command]` reconnects to a specific `open-computer-use` binary.
- `/ocu-close` shuts the MCP child process down.
在 GitHub 查看