메뉴
Run the evaluation suite on the current harness or a specific candidate run. Reports deterministic check results and LLM-judge assessment.
Codex 또는 Claude로 설치 이 Prompt를 복사해 Codex, Claude 또는 다른 어시스턴트에 붙여 넣으면 Skill 페이지를 검토하고 설치를 진행할 수 있습니다.
SOC 직업 분류 기준
Evolve repo-local Claude Code harness assets through a 5-phase pipeline — harvest context, propose candidate, evaluate with evidence, audit regressions, report results.
Full Meta-Harness status view — Pareto frontier, recent runs, regressions, eval health, installed plugins.
Analyze the current project and generate initial eval tasks for harness optimization. Creates regression and capability eval tasks based on project structure.
Summarize the current Meta-Harness-style frontier of harness candidates, including quality, cost, latency, and safety notes.
Audit recent regressions in the harness search and identify likely confounds, brittle edits, and safer next-step ideas.
| name | eval |
| description | Run the evaluation suite on the current harness or a specific candidate run. Reports deterministic check results and LLM-judge assessment. |
| disable-model-invocation | true |
| allowed-tools | Read Grep Glob Bash(python3 *) Bash(git *) |
Run the evaluation suite to measure harness quality.
python3 ${CLAUDE_PLUGIN_ROOT}/scripts/eval_runner.py --eval-dir ${CLAUDE_PLUGIN_ROOT}/eval-tasks --cwd . 2>&1 || echo "Eval runner not available"
llm_judge criteria, evaluate the criteria manually:
If a specific run_id was provided as $ARGUMENTS, evaluate that candidate's artifacts in runs/{run_id}/. Otherwise, evaluate the current harness state.