| name | oni-game-automation |
| description | Control ONI desktop automation from the Python bridge with explicit launch/save/screenshot/mouse/keyboard operations. |
ONI Game Automation Skill
Purpose
Use Python bridge desktop APIs to launch ONI, capture screenshots, and perform deterministic input automation.
Endpoints
GET /desktop/status
POST /desktop/toggle
POST /desktop/stop
POST /desktop/screenshot
POST /desktop/mouse
POST /desktop/keyboard
Action Types
launch_game or launch_oni
save_game
screenshot or capture_screenshot
mouse_move, mouse_click, mouse_scroll
keyboard_type, keyboard_press, keyboard_hotkey
wait
Runtime Controls
- Press
~ to stop current automation loop.
- Loop also stops automatically when all actions finish.
Environment
ONI_AI_GAME_LAUNCH_CMD: custom launch command.
ONI_AI_SAVE_HOTKEY: fallback save hotkey sequence (default f5).
Validation
- Check
GET /desktop/status before and after action runs.
- Use
POST /desktop/screenshot to validate capture path and permissions.
- Run
uv run pytest tests/test_ai_bridge.py -q after changes.