kaijuengine-aidriver

name

kaijuengine-aidriver

description

Drive an already-running Kaiju game through its built-in AI Driver HTTP server (localhost, enabled by the `ai_driver` build tag): capture screenshots of the game window and inject mouse/keyboard input (click, type, scroll, key presses), loop screenshot then reason then act then re-screenshot, and quit the game gracefully. Use this whenever the user wants to look at, inspect, interact with, control, or visually verify the running kaiju game — for example "screenshot the game", "click the start button", "type into the name field", "is the menu rendering correctly", or "check my UI change in the running app" — even if they don't mention ai_driver or curl. Prefer this over the generic run/verify skills for a kaiju game that exposes the AI Driver server, since it talks to the live process via curl rather than launching or rebuilding it. Requires the game built with the `ai_driver` tag.

Kaiju AI Driver

You control a running kaiju game by taking screenshots and injecting mouse/keyboard input through a localhost HTTP server compiled into the game. You talk to it with curl. No authentication; it binds 127.0.0.1 only.

Preconditions

The game must be running and built with the ai_driver tag:

go run -tags ai_driver .          # or: go build -tags ai_driver -o game . && ./game

On startup it logs AI Driver started addr=127.0.0.1:7777. Default port is 7777; override with the AI_DRIVER_PORT env var.

Confirm it is up before doing anything else:

curl -s http://127.0.0.1:7777/v1/health

If this fails to connect, the game is not running or was built without -tags ai_driver. Ask the user to launch it that way; do not try to start it yourself unless asked.

Coordinate & timing contract (do not violate)

• Coordinates are SCREENSHOT PIXELS, top-left origin (+x right, +y down). Read a pixel straight off the screenshot you just looked at and send that exact pixel. The server converts to the engine's logical points for you — never multiply or divide coordinates yourself, even on a Retina display.