Menu
Run, inspect, and debug cli-evals suites for live coding-agent CLI evaluations.
Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.
Based on SOC occupation classification
| name | cli-evals |
| description | Run, inspect, and debug cli-evals suites for live coding-agent CLI evaluations. |
Use this skill when a user wants to run a live eval suite, compare agents, inspect reports, rebuild metrics, or diagnose local prerequisites.
cli-evals doctor first when the target agent or auth state is unclear.cli-evals list --suite <config>.cli-evals run --suite <config> --canary --agent <agent> --model <model>.--filter <EV-ID> for a failing scenario and add --keep to preserve the
workdir.cli-evals rebuild --report <evals/reports/latest.json>.Do not trigger --all live agent runs without the user explicitly asking; they
cost time, tokens, and may use authenticated agent sessions.