| name | release-gate |
| description | Run agentic-evalkit's offline verification matrix and release gates in order, reporting pass/fail per gate. Use before opening a PR, before tagging a release, or when asked to "run the gates", "verify the release", or "check release readiness". |
Release Gate Runner
Single source of truth for the verification every change and release must
pass. CONTRIBUTING.md describes these gates in prose and
.github/workflows/release-gates.yml runs the release subset in CI; this
skill executes them locally, in order, with one command per gate.
Steps
-
Sync the environment once — and never run two gate sequences
concurrently; parallel uv invocations race on .venv:
uv sync --all-groups
-
Run the offline verification matrix, in order. Stop and report the first
failure with its output; do not continue past a red gate:
uv run pytest --cov --cov-report=term-missing
uv run ruff check .
uv run ruff format --check .
uv run mypy
(pytest deselects live-marked tests by default via addopts; the
coverage floor is 80% branch-aware and fails the run by itself.)
-
For a release, additionally run the offline release gates:
uv run pytest tests/contract/test_dependency_boundary.py tests/contract/test_adrs.py tests/contract/test_public_docs.py -v
uv run mkdocs build --strict
uv run pytest tests/integration/test_clean_wheel.py -v
-
The live Hugging Face gate requires network access and is never part of
the default matrix. Run it explicitly, or dispatch
.github/workflows/live-provider.yml (the only CI workflow allowed to
touch the real network path):
uv run pytest tests/live/test_huggingface_live.py -m live -v
-
Report results as a table — gate, command, PASS/FAIL — followed by the
failing output for any FAIL. A classified transient outage on the live
gate is a known issue to document, never something to retry into a false
pass.
To run everything unattended in one pass instead of step by step:
bash .claude/skills/release-gate/scripts/run-gates.sh
bash .claude/skills/release-gate/scripts/run-gates.sh --release
bash .claude/skills/release-gate/scripts/run-gates.sh --release --live
References
references/gate-commands.md — every gate with what it proves and its
typical failure modes.
