run-e2e

name	run-e2e
description	Run the toolbox-web Playwright e2e suites — docs-demo tests, cross-framework parity tests, performance-regression and stability tests. Covers starting demo servers, the various run commands, and updating visual baselines.

Run E2E Suites

Two Playwright e2e suites exist. This skill is the runbook — how to execute them and manage servers/baselines. For how to write e2e tests (conventions, utilities, selectors, wait strategies), see the auto-applied e2e-testing instruction.

Suite	Location	Purpose	Server
Docs demos	apps/docs-e2e/	Every Astro demo page renders and works correctly	Auto-starts Astro on port 4450
Cross-framework	e2e/	Visual/functional parity across Vanilla, React, Angular, Vue demos	Manual server start required

Docs demo tests

Auto-starts the Astro dev server — no manual setup:

bun nx e2e docs-e2e

Cross-framework tests

Demo servers must be running first (these tests do not auto-start servers).

# Option 1: start the 4 demo servers in a separate terminal, then run tests
bun run demo              # vanilla=4000, react=4300, angular=4200, vue=4100
bun nx e2e e2e            # run tests against the running servers

# Option 2: build + start dist servers + wait for ports + test (CI-friendly)
bun run e2e:full

If a run fails with connection-refused / timeout on ports 4000/4100/4200/4300, the demo servers aren't up — start them (Option 1) or use e2e:full (Option 2).

Update visual baselines

Only after intentionally changing rendered output. Review the regenerated PNGs before committing.

bun nx e2e:update-snapshots e2e

Performance-regression tests

Part of the regular e2e suite. Compares the current build against the latest published release (loaded from CDN) in the same browser session, so runner variance cancels out. Flags a regression if the current build is >10% slower; auto-retries up to 2× to absorb CI noise.

# Requires a build first (for the local UMD bundle)
bun nx build grid

# Run the self-comparison tests (no demo server needed)
bunx playwright test --config=e2e/playwright.config.ts performance-regression

Env var	Purpose
PERF_CDN_VERSION	Override CDN version to compare against (default: latest)
PERF_RUN_ID	Unique ID for the output file (perf-metrics-{runId}.json)

Grid-stability tests

Structural assertions against the vanilla demo (virtualization bounds, zero JS errors, no memory/DOM leaks). Fast, deterministic, part of the regular e2e suite — no separate command needed.

File	Purpose
e2e/tests/performance-regression.spec.ts	Self-comparison benchmarks (no demo needed)
e2e/tests/grid-stability.spec.ts	Structural stability tests (vanilla demo)
e2e/tests/perf-metrics-helper.ts	Metric accumulator + flush utility