| name | test-electron-app |
| description | Drive the real running PostHog Code Electron app (live tRPC, workspace-server, real data) over CDP with agent-browser. Connect to the running app on port 9222, snapshot the accessibility tree to verify changes, click/type/navigate, and screenshot the actual desktop app only when explicitly asked. Use when asked to test, verify, dogfood, screenshot or interact with the running app. For regression specs use the Playwright E2E suite. |
| allowed-tools | Bash(agent-browser:*), Bash(npx agent-browser:*), Bash(pnpm app:cdp*) |
Test the real PostHog Code Electron app
Drive the actual running app over the Chrome DevTools Protocol with
agent-browser. The dev app
already launches with --remote-debugging-port=9222 (see apps/code/package.json),
so an agent can connect, snapshot the UI, interact, and (only when asked) screenshot the live app.
This exercises real state: live tRPC, workspace-server, GitHub/Slack and
whatever profile is signed into ~/.posthog-code. Pick the right surface:
| Goal | Tool |
|---|
| Verify or screenshot a change in the real app, live data | this skill (agent-browser + CDP :9222) |
| Regression coverage in CI | Playwright E2E (apps/code/tests/e2e/) |
Prerequisites
npm i -g agent-browser && agent-browser install
The app must be running with remote debugging. pnpm dev (or pnpm dev:code)
already passes --remote-debugging-port=9222. Preflight + connect:
pnpm app:cdp
If it reports the app is not reachable, the app isn't running. Start it, then
retry pnpm app:cdp.
Launching the app yourself (background / no TTY)
Do not use pnpm dev from a non-interactive shell. It builds deps then hands
off to the phrocs TUI process-multiplexer, which aborts without a controlling
terminal (bubbletea: could not open TTY: /dev/tty: device not configured). An
agent in a background shell has no TTY, so pnpm dev cannot launch it headlessly.
Build the workspace deps (TTY-safe, the same step pnpm dev runs first), then
launch only the Electron app with its stdin held open:
pnpm build:deps
tail -f /dev/null | pnpm dev:code
pnpm dev:code is pnpm --filter code start, i.e. electron-vite dev --watch — just
the app, no phrocs TUI; it watches and rebuilds main/preload and hot-reloads the
renderer (fine for screenshotting/interacting). The CDP port (:9222) is opened by
the app itself in dev (the remote-debugging-port switch in
apps/code/src/main/bootstrap.ts), not by a CLI flag.
The tail -f /dev/null | prefix is a harmless guard and no longer strictly required.
The old electron-forge start ran an interactive "type rs to restart" stdin reader
that hit EOF in a no-stdin shell, treated it as quit, and tore the Electron window
down before the CDP port ever opened. electron-vite dev has no such reader, so a
backgrounded pnpm dev:code with no stdin stays up on its own; keeping the pipe does
no harm.
Then wait for the port and connect (poll, don't sleep blindly):
until curl -s localhost:9222/json/version >/dev/null; do sleep 1; done
agent-browser connect 9222
After you launch it: leave it up, then idle-shutdown
Never auto-kill an instance you didn't start. If pnpm app:cdp found the app
already up on :9222, it's the user's own — when you're done just agent-browser close your session and leave the app running.
When you launched it, don't tear it down the instant you finish. The app
survives between turns, so leave it up and end your turn by telling the user it's
still running and asking if they want anything else — a follow-up needs no
relaunch.
So a forgotten app doesn't linger, arm a 10-minute idle watchdog at launch.
Touch a marker file on launch and after every interaction; the watchdog tears the
app down once that file sits untouched for 10 minutes (re-touching resets the
clock):
touch /tmp/posthog-dev-lastuse
Then start the watchdog once, as a background task (touch the marker first or it
fires immediately). It polls, then self-exits after it fires or once the marker is
removed:
while sleep 30; do
last=$(stat -f %m /tmp/posthog-dev-lastuse 2>/dev/null || echo 0)
[ $(( $(date +%s) - last )) -ge 600 ] && break
done
pid=$(pgrep -f "remote-debugging-port=9222" | head -1)
[ -n "$pid" ] && kill -TERM "-$(ps -o pgid= -p "$pid" | tr -d ' ')" 2>/dev/null
To stop early (user says "done" / "shut it down"): close the session, group-kill
the app, and drop the marker so the watchdog exits:
agent-browser close
pid=$(pgrep -f "remote-debugging-port=9222" | head -1)
[ -n "$pid" ] && kill -TERM "-$(ps -o pgid= -p "$pid" | tr -d ' ')" 2>/dev/null
rm -f /tmp/posthog-dev-lastuse
Group-killing the launcher (kill -TERM -PGID) takes down tail, pnpm,
electron-vite and Electron together, so nothing — not even the
tail -f /dev/null stdin pipe — lingers. Matching remote-debugging-port=9222
hits only your dev instance (prod has no debug port and a separate
posthog-code-dev profile), so it never touches the user's app. Verify with
curl -s localhost:9222/json/version (fails) and pgrep -fl posthog-code-dev
(empty).
Load the canonical commands
agent-browser serves version-matched docs. Read them before driving:
agent-browser skills get electron
agent-browser skills get core
The loop
agent-browser connect 9222
agent-browser snapshot -i
agent-browser click @e5
agent-browser snapshot -i
agent-browser close
Verifying a change is snapshot, not screenshot. The accessibility tree
tells you what is on screen for almost no tokens, and it is how you confirm a test
worked. Do not capture a screenshot to check your own work — only run screenshot
when the user explicitly asks to see the app (see Screenshots).
Refs (@e1, @e2, …) are reassigned on every snapshot and go stale the moment
the UI changes. Re-snapshot before the next ref interaction.
The renderer uses data-testid heavily, so prefer stable locators over refs
when you know the target:
agent-browser find testid new-task-button click
agent-browser find role button click --name "New task"
agent-browser find text "Settings" click
Screenshots
Only screenshot when the user explicitly asks for one ("screenshot", "show
me", "what does it look like"). To confirm a change worked, use agent-browser snapshot — the accessibility tree is the cheap default and is almost always
enough. Auto-capturing a screenshot to "confirm" your work just burns image
tokens.
agent-browser screenshot /tmp/app.png
agent-browser screenshot --full /tmp/app.png
Navigate to the target view first (click through the UI), then capture. agent-browser prints the saved path. Repeated captures reuse the connected session, so batches are fast.
Always let the user open the capture
When the user asked for a screenshot, they want to look at it, so close the loop every time:
- Save to and report an absolute path (
/tmp/app.png, never a bare out.png). Claude Code renders absolute paths as clickable links, so the path itself opens the PNG on click.
- Offer to open it for them, and on a yes run
open /tmp/app.png (macOS opens it in Preview). If the request was clearly "screenshot it so I can see it", just open it instead of asking.
- The user can also open it themselves at any time with
!open /tmp/app.png.
Repo specifics
- Port:
9222 (override with POSTHOG_CODE_CDP_PORT). Collides with Chrome's
default debugging port; if connect attaches to the wrong target, list and
pick the PostHog window: agent-browser tab then agent-browser tab --url "*".
- Multiple targets: the app has a main renderer window (page title contains
"PostHog Code") plus possible webviews/devtools.
agent-browser tab lists them;
switch with agent-browser tab <index>.
- Never pass
--color-scheme dark: that global flag makes agent-browser apply
device emulation that forces a 1280x720 viewport and renders this Electron window
blank, and it sticks in the daemon (only restarting the agent-browser daemon
clears it, not close). The app is already dark, so plain agent-browser snapshot / agent-browser screenshot is what you want.
- Auth / data: you drive whatever is signed into
~/.posthog-code. If the app
shows onboarding or sign-in, that is the real boot state. Do not mutate
production data (don't create real tasks/PRs) while exploring.
- Boot timing: after launching the app, give it a few seconds before
connecting; the renderer settles after
#root > * appears and "Loading" clears.
Running alongside prod
PostHog Code orchestrates the agent, so the usual loop is: prod (the installed app) runs the agent, and the dev build (pnpm dev) is the system under test. They coexist by design (apps/code/src/main/bootstrap.ts): dev runs as posthog-code-dev with its own app name, userData and single-instance lock, so it never collides with prod.
- agent-browser always targets dev. Only the dev build exposes CDP on
:9222; prod has no debug port, so connect 9222 can't accidentally drive prod.
- Separate auth/state. The dev instance has its own
posthog-code-dev profile; it is not signed in just because prod is. Sign into the dev window once; its state persists.
- One dev instance only. Dev's single-instance lock, fixed dev callback port (
8238) and :9222 mean a second pnpm dev collides and quits. Run prod + one dev.
- What reloads. Renderer/UI changes hot-reload; just re-snapshot. Main-process/Electron changes need a dev restart to take effect.
Troubleshooting
- Connection refused on :9222: the app isn't running with the debug flag.
Start it (see Launching the app yourself for the headless recipe). Verify the
port:
lsof -i :9222 or curl -s localhost:9222/json/version.
- App launches then immediately exits; CDP never opens: the old
electron-forge
"quit on stdin EOF" behavior is gone under electron-vite, so the
tail -f /dev/null | prefix is optional and not the fix here. This is now usually a
build error, the single-instance lock (another dev instance running) or a crash —
check the pnpm dev:code output. Note pnpm dev cannot run headlessly at all — its
phrocs TUI needs a TTY; use pnpm dev:code.
- Snapshot is empty / wrong window: you're on the wrong target. Run
agent-browser tab and switch to the "PostHog Code" page.
- Can't type into an input: try
agent-browser keyboard type "text" (types at
current focus) or agent-browser keyboard inserttext "text" to bypass key events.