schaltwerk-linux-cua

Use when the user wants agent-driven UI testing of Schaltwerk inside an isolated Linux container. This skill builds the local Docker image, syncs the current repo into the container, launches the Linux Schaltwerk build under Xvfb/openbox, exposes a Cua computer-server, and runs OpenAI computer-use tests through scripts/cua/schaltwerk-cua.js.

Jump to install

Repository: 2mawi2/schaltwerk
Last source activity: July 25, 2026 at 08:07
Detected SKILL.md language: English
Stars: 286
Forks: 27

Install options

The review-first prompt is selected by default. You can switch to a direct command or download a local copy.

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

A direct command skips the review prompt. Inspect the source before running it.

npx skills add https://github.com/2mawi2/schaltwerk --skill schaltwerk-linux-cua

The command stays on one line. Scroll horizontally to inspect it before copying.

Prefer a local copy? Download the files currently available to SkillsMP.

Review the source files

Read SKILL.md and any companion files shown by SkillsMP before deciding whether to install.

SKILL.md

Source instructions · Read-only preview

Back to search Back to installation

Schaltwerk Linux CUA

Use this skill from the Schaltwerk repo root when the user wants Schaltwerk tested through OpenAI computer use without controlling the host macOS desktop.

Preconditions

Docker or OrbStack is running.

Work from the Schaltwerk repo root so the source mount points at the current checkout.

OPENAI_API_KEY is only required for autonomous cua:test runs. Manual observe/act testing does not need it.

Default workflow

Prepare the containerized Linux desktop: bun run cua:container:prepare

Verify the app, fixture repository, and Cua backend: bun run cua:container:status bun run cua:container:fixture-status bun run cua:container:probe

Capture and inspect the current desktop: bun run cua:container:observe Read the returned screenshot path before deciding the next action.

Interact through the Cua backend, then observe again: bun run cua:container:click -- --x 100 --y 200 bun run cua:container:type -- --text "Text to enter" bun run cua:container:press -- --keys CTRL+ENTER Other commands are cua:double-click, cua:drag, cua:move, and cua:scroll.

Check the app log and fixture state after meaningful transitions: bun run cua:container:logs bun run cua:container:fixture-status

Optionally run an autonomous computer-use test prompt: bun run cua:container:test -- --no-prepare --prompt "Open Schaltwerk, exercise the target flow, and report findings."

Inspect artifacts under logs/cua/ for backend probes, screenshots, action traces, status snapshots, and raw Responses API payloads.

Shut the container down when finished: bun run cua:container:stop

Notes

The container exposes Schaltwerk over noVNC at http://127.0.0.1:6081/vnc.html?autoconnect=1.

The container also exposes a Cua-compatible computer-server on http://127.0.0.1:8002.

Schaltwerk starts against a fresh disposable Git repository under /home/schaltwerk/runtime/fixture-project.

Common agent executables are deterministic local stubs so running-session and terminal flows can be tested without external credentials.

bun run cua:container:smoke reuses the current container unless --prepare true is passed.

The default desktop backend is cua; pass --backend desktopctl to fall back to the original direct Docker control path.

bun run cua:container:test runs prepare automatically unless --no-prepare is passed.

For repeat runs after code changes, rerun bun run cua:container:prepare so the container rebuilds the Linux binary from the current checkout.

Keep prompts explicit about the flow to test and the expected assertions. The runner already tells the model to stay inside the local Schaltwerk desktop.