| name | splitshot-test-triage |
| description | Use SplitShot's canonical test runner to verify changes, isolate failures, and triage failing suites with the repo's existing uv/pytest workflow. |
Use this skill when:
- Any SplitShot change needs verification.
- CI fails.
- A test suite fails locally.
- Core Python modules, browser code, export/media paths, or controller logic changed.
- The manager asks to test, verify, or triage failures.
Default approach:
- Use the repo's canonical test orchestrator first.
- Then narrow to direct pytest only after the failing area is known.
- Do not invent new test commands.
- Do not skip proof.
Commands:
Bootstrap only when dependencies are missing:
uv sync --extra dev
Install Playwright browsers only when browser tests or audits require them:
uv run python -m playwright install chromium firefox webkit
Run the canonical suite:
uv run python scripts/testing/run_test_suite.py --mode all-together --format table
If failures occur, isolate with JSON output:
uv run python scripts/testing/run_test_suite.py --mode one-by-one --format json --json-output artifacts/test-run.json --stop-on-failure
Then run the failing target directly:
uv run pytest tests/<path>/test_foo.py -k <expression>
Browser-specific verification:
uv run pytest tests/browser/
Analysis-specific verification:
uv run pytest tests/analysis/
Done means:
- The relevant suite passes, or the exact failing suite/test is identified.
- Any failing command is reported with the command, failure area, and likely cause.
- Browser UI/server/controller changes include browser-specific verification.
- The final report includes proof.
Token Budget
Testing can be expensive. Minimize output.
Rules:
- Run targeted tests before broad suites.
- Use
--format table or --json-output artifacts/... when available.
- Do not include full logs in responses.
- Summarize failures by suite, test name, and key error only.
- Do not rerun unchanged failures.
- Escalate to full suite only after targeted checks pass or when requested.
Report:
Changed:
Verified:
Result:
Risks:
