| name | skills-eval |
| description | Evaluate and improve Claude skill quality through auditing. Use when reviewing skill quality, preparing skills for production, or auditing existing skills. Do not use when creating new skills (use modular-skills) or writing prose (use writing-clearly-and-concisely). Use this skill before shipping any skill to production. |
| category | skill-management |
| tags | ["evaluation","improvement","skills","optimization","quality-assurance","tool-use","performance-metrics"] |
| dependencies | ["modular-skills","performance-optimization"] |
| tools | ["skills-auditor","improvement-suggester","compliance-checker","tool-performance-analyzer","token-usage-tracker"] |
| provides | {"infrastructure":["evaluation-framework","quality-assurance","improvement-planning"],"patterns":["skill-analysis","token-optimization","modular-design"],"sdk_features":["agent-sdk-compatibility","advanced-metrics","dynamic-discovery"]} |
| estimated_tokens | 1800 |
| usage_patterns | ["skill-audit","quality-assessment","improvement-planning","skills-inventory","tool-performance-evaluation","dynamic-discovery-optimization","advanced-tool-use-analysis","programmatic-calling-efficiency","context-preservation-quality","token-efficiency-optimization","modular-architecture-validation","integration-testing","compliance-reporting","performance-benchmarking"] |
| complexity | advanced |
| evaluation_criteria | {"structure_compliance":25,"metadata_quality":20,"token_efficiency":25,"tool_integration":20,"claude_sdk_compliance":10} |
| modules | ["modules/advanced-tool-use-analysis.md","modules/authoring-checklist.md","modules/evaluation-criteria.md","modules/evaluation-framework.md","modules/evaluation-workflows.md","modules/integration-testing.md","modules/integration.md","modules/multi-metric-evaluation-methodology.md","modules/performance-benchmarking.md","modules/pressure-testing.md","modules/quality-metrics.md","modules/skill-authoring-best-practices.md","modules/trigger-isolation-analysis.md","modules/troubleshooting.md"] |
Skills Evaluation and Improvement
Table of Contents
- Overview
- Quick Start
- Evaluation Workflow
- Evaluation and Optimization
- Resources
Overview
This framework audits Claude skills against quality standards to improve performance and reduce token consumption. Automated tools analyze skill structure, measure context usage, and identify specific technical improvements. Run verification commands after each audit to confirm fixes work correctly.
The skills-auditor provides structural analysis, while the improvement-suggester ranks fixes by impact. Compliance is verified through the compliance-checker. Runtime efficiency is monitored by tool-performance-analyzer and token-usage-tracker.
Quick Start
Basic Audit
Run a full audit of all skills or target a specific file to identify structural issues.
make audit-all
make audit-skill TARGET=path/to/skill/SKILL.md
Analysis and Optimization
Use skill_analyzer.py for complexity checks and token_estimator.py to verify the context budget.
make analyze-skill TARGET=path/to/skill/SKILL.md
make estimate-tokens TARGET=path/to/skill/SKILL.md
Improvements
Generate a prioritized plan and verify standards compliance using improvement_suggester.py and compliance_checker.py.
make improve-skill TARGET=path/to/skill/SKILL.md
make check-compliance TARGET=path/to/skill/SKILL.md
Evaluation Workflow
Start with make audit-all to inventory skills and identify high-priority targets. For each skill requiring attention, run analysis with analyze-skill to map complexity. Generate an improvement plan, apply fixes, and run check-compliance to verify the skill meets project standards. Finalize by checking the token budget for efficiency.
Evaluation and Optimization
Quality assessments use the skills-auditor and improvement-suggester to generate detailed reports. Performance analysis focuses on token efficiency through the and tool performance via . For standards compliance, the automates common fixes for structural issues.
