oni-game-automation

name	oni-game-automation
description	Control ONI desktop automation from the Python bridge with explicit launch/save/screenshot/mouse/keyboard operations.

ONI Game Automation Skill

Purpose

Use Python bridge desktop APIs to launch ONI, capture screenshots, and perform deterministic input automation.

Endpoints

• GET /desktop/status
• POST /desktop/toggle
• POST /desktop/stop
• POST /desktop/screenshot
• POST /desktop/mouse
• POST /desktop/keyboard

Action Types

• launch_game or launch_oni
• save_game
• screenshot or capture_screenshot
• mouse_move, mouse_click, mouse_scroll
• keyboard_type, keyboard_press, keyboard_hotkey
• wait

Runtime Controls

• Press ~ to stop current automation loop.
• Loop also stops automatically when all actions finish.

Environment

• ONI_AI_GAME_LAUNCH_CMD: custom launch command.
• ONI_AI_SAVE_HOTKEY: fallback save hotkey sequence (default f5).

Validation

• Check GET /desktop/status before and after action runs.
• Use POST /desktop/screenshot to validate capture path and permissions.
• Run uv run pytest tests/test_ai_bridge.py -q after changes.