pi-codex-computer-use
Use Pi's Open Computer Use / Codex-style computer-use tools to inspect and operate local GUI apps through Accessibility/Screen Recording. Use when a task needs desktop app state, clicking, typing, scrolling, or Codex Computer Use from Pi.
معلومات المصدر
- المستودع
- joelhooks/pi-codex-computer-use
- آخر نشاط في المصدر
- ٩ أغسطس ٢٠٢٦ في ١٩:١١
- لغة SKILL.md المكتشفة
- الإنجليزية
- النجوم
- ٠
- التفرعات
- ٠
خيارات التثبيت
يُحدَّد Prompt الذي يراجع المصدر أولًا بشكل افتراضي. يمكنك التبديل إلى أمر مباشر أو تنزيل نسخة محلية.
مراجعة ملفات المصدر
اقرأ SKILL.md وأي ملفات مرافقة يعرضها SkillsMP قبل أن تقرر التثبيت.
عرض SKILL.md
SKILL.md
تعليمات المصدر · معاينة للقراءة فقط- name
- pi-codex-computer-use
- description
- Use Pi's Open Computer Use / Codex-style computer-use tools to inspect and operate local GUI apps through Accessibility/Screen Recording. Use when a task needs desktop app state, clicking, typing, scrolling, or Codex Computer Use from Pi.
- disable-model-invocation
- true
# Pi Codex Computer Use
This package exposes Open Computer Use as Pi tools with the `computer_use_` prefix.
## Workflow
1. If permissions or connection are unknown, run `computer_use_status` or `computer_use_doctor`.
2. Use `computer_use_list_apps` to discover app names.
3. Call `computer_use_get_app_state` before every action turn. Use `show_full_text: true` for long chat/email/document text.
4. Prefer element indexes from the latest app state.
5. Use coordinate click/drag only when the accessibility tree does not expose a safer target.
6. Use `computer_use_sequence` for short multi-step flows that need to reuse the same snapshot and element indexes.
7. Ask before sending, deleting, purchasing, approving prompts, uploading files, or interacting with password managers/sensitive apps.
## Tools
- `computer_use_list_apps({})`
- `computer_use_get_app_state({ app, show_full_text? })`
- `computer_use_click({ app, element_index? , x?, y?, click_count?, mouse_button? })`
- `computer_use_perform_secondary_action({ app, element_index, action })`
- `computer_use_scroll({ app, element_index, direction, pages? })`
- `computer_use_drag({ app, from_x, from_y, to_x, to_y })`
- `computer_use_type_text({ app, text })`
- `computer_use_press_key({ app, key })`
- `computer_use_set_value({ app, element_index, value })`
- `computer_use_sequence({ calls })`
## Human commands
- `/ocu-doctor` checks permissions and opens macOS onboarding if needed.
- `/ocu-status` reports connection and command resolution.
- `/ocu-open [command]` reconnects to a specific `open-computer-use` binary.
- `/ocu-close` shuts the MCP child process down.
عرض على GitHub