pi-codex-computer-use
Use Pi's Open Computer Use / Codex-style computer-use tools to inspect and operate local GUI apps through Accessibility/Screen Recording. Use when a task needs desktop app state, clicking, typing, scrolling, or Codex Computer Use from Pi.
ソース情報
- リポジトリ
- joelhooks/pi-codex-computer-use
- ソースの最終更新活動
- 2026年8月9日 19:11
- 検出された SKILL.md の言語
- 英語
- スター
- 0
- フォーク
- 0
インストール方法
デフォルトでは、最初にソースを確認する Prompt が選択されています。直接コマンドに切り替えるか、ローカルコピーをダウンロードすることもできます。
ソースファイルを確認
インストールを決める前に、SKILL.md と SkillsMP に表示されている付属ファイルをお読みください。
SKILL.md を表示中
SKILL.md
ソースの指示 · 読み取り専用プレビュー- name
- pi-codex-computer-use
- description
- Use Pi's Open Computer Use / Codex-style computer-use tools to inspect and operate local GUI apps through Accessibility/Screen Recording. Use when a task needs desktop app state, clicking, typing, scrolling, or Codex Computer Use from Pi.
- disable-model-invocation
- true
# Pi Codex Computer Use
This package exposes Open Computer Use as Pi tools with the `computer_use_` prefix.
## Workflow
1. If permissions or connection are unknown, run `computer_use_status` or `computer_use_doctor`.
2. Use `computer_use_list_apps` to discover app names.
3. Call `computer_use_get_app_state` before every action turn. Use `show_full_text: true` for long chat/email/document text.
4. Prefer element indexes from the latest app state.
5. Use coordinate click/drag only when the accessibility tree does not expose a safer target.
6. Use `computer_use_sequence` for short multi-step flows that need to reuse the same snapshot and element indexes.
7. Ask before sending, deleting, purchasing, approving prompts, uploading files, or interacting with password managers/sensitive apps.
## Tools
- `computer_use_list_apps({})`
- `computer_use_get_app_state({ app, show_full_text? })`
- `computer_use_click({ app, element_index? , x?, y?, click_count?, mouse_button? })`
- `computer_use_perform_secondary_action({ app, element_index, action })`
- `computer_use_scroll({ app, element_index, direction, pages? })`
- `computer_use_drag({ app, from_x, from_y, to_x, to_y })`
- `computer_use_type_text({ app, text })`
- `computer_use_press_key({ app, key })`
- `computer_use_set_value({ app, element_index, value })`
- `computer_use_sequence({ calls })`
## Human commands
- `/ocu-doctor` checks permissions and opens macOS onboarding if needed.
- `/ocu-status` reports connection and command resolution.
- `/ocu-open [command]` reconnects to a specific `open-computer-use` binary.
- `/ocu-close` shuts the MCP child process down.
GitHubで見る