Menu
Run smoke tests on a deployed environment to ensure basic functionality.
Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.
Based on SOC occupation classification
Use when the user asks to update, sync, or refresh the Hawk docs (quickstart, configuration reference, infrastructure description and diagrams) to reflect changes since the last documentation sync. Triggers on "update the docs", "sync docs", "docs are stale", "refresh quickstart", "update the architecture diagram", or after merging infra/config/CLI changes that affect user-visible setup.
Debug stuck Hawk/Inspect AI evaluations. Use when user mentions "stuck eval", "eval not progressing", "eval hanging", "samples not completing", "eval set frozen", "runner stuck", "500 errors in eval", "retry loop", "eval timeout", or asks why an evaluation isn't finishing.
How to create and use our alembic database migration tool. Use when making changes to models.py.
How to develop the frontend and backend together. When you want to make changes to the UI, use this.
Monitor Hawk job status, view logs, and diagnose issues. Use when the user wants to check job progress, view error logs, debug a failing job, or generate a monitoring report for a Hawk evaluation run.
View and analyze Hawk evaluation results. Use when the user wants to see eval-set results, check evaluation status, list samples, view transcripts, or analyze agent behavior from a completed evaluation run.
| name | smoke-tests |
| description | Run smoke tests on a deployed environment to ensure basic functionality. |
Run hawk login first if not logged in. Full docs in hawk/tests/smoke/README.md.
scripts/dev/smoke # current Pulumi stack, includes warehouse
scripts/dev/smoke --stack staging # target a specific stack
scripts/dev/smoke -k test_real_llm # pass args through to pytest
scripts/dev/smoke --skip-warehouse # exclude warehouse checks