| name | evaluate-plugin-batch |
| description | Batch evaluate every skill in a plugin and produce a plugin-level report. Use when auditing an entire plugin's quality or validating before a release. |
| args | <plugin-name> [--create-missing-evals] [--parallel N] |
| allowed-tools | Task, Read, Write, Glob, Grep, Bash(bash *), SlashCommand, TodoWrite |
| argument-hint | git-plugin [--create-missing-evals] |
| agent | general-purpose |
| created | "2026-03-04T00:00:00.000Z" |
| modified | "2026-07-18T00:00:00.000Z" |
| compatibility | claude-code |
| reviewed | "2026-03-04T00:00:00.000Z" |
/evaluate:plugin
Batch evaluate all skills in a plugin. Runs /evaluate:skill for each skill, then produces a plugin-level quality report.
When to Use This Skill
| Use this skill when... | Use alternative when... |
|---|
| Auditing all skills in a plugin before release | Evaluating a single skill -> /evaluate:skill |
| Establishing quality baselines across a plugin | Viewing past results -> /evaluate:report |
| Checking overall plugin quality after refactoring | Need structural compliance -> plugin-compliance-check.sh |
Context
- Available plugins: !
find . -maxdepth 2 -type d -name '*-plugin' -not -name '.claude-plugin'
Parameters
Parse these from $ARGUMENTS:
| Parameter | Default | Description |
|---|
<plugin-name> | required | Name of the plugin to evaluate |
--create-missing-evals | false | Generate evals for skills that lack them |
--parallel N | 1 | Max concurrent skill evaluations |
Execution
Step 1: Discover skills
Find all skills in the plugin:
<plugin-name>/skills/*/SKILL.md
List them and count the total.
Step 2: Filter and prepare
For each skill, check if evals.json exists:
- Has evals: include in evaluation
- No evals +
--create-missing-evals: include, will create evals during evaluation
- No evals, no flag: skip with a note
Report the breakdown:
Found N skills in <plugin-name>:
- M with eval cases
- K without eval cases (skipped | will create)
Step 3: Run evaluations
For each included skill, invoke /evaluate:skill via the SlashCommand tool:
SlashCommand: /evaluate:skill <plugin-name>/<skill-name> [--create-evals]
