| name | response-rater |
| description | Rates responses and plans against quality rubrics. Used for plan validation, response quality audits, and multi-agent consensus. |
| version | 2 |
| model | sonnet |
| invoked_by | both |
| user_invocable | true |
| tools | ["Read","Write","Edit","Bash","Glob","Grep"] |
| best_practices | ["Use consistent rubric dimensions","Require minimum scores for approval","Document improvement suggestions","Track scores over time"] |
| error_handling | graceful |
| streaming | supported |
Response Rater Skill
Response Rater - Rates responses and plans against quality rubrics. Provides scores, feedback, and improvement suggestions.
- Rating responses against rubrics
- Validating plan quality
- Providing improvement feedback
- Generating quality reports
Step 1: Define Rating Rubric
Use appropriate rubric for the content type:
For Plans:
| Dimension | Weight | Description |
|---|
| Completeness | 20% | All required sections present |
| Feasibility | 20% | Plan is realistic and achievable |
| Risk Mitigation | 20% | Risks identified with mitigations |
| Agent Coverage | 20% | Appropriate agents assigned |
| Integration | 20% | Fits with existing systems |
For Responses:
| Dimension | Weight | Description |
|---|
| Correctness | 25% | Technically accurate |
| Completeness | 25% | Addresses all requirements |
| Clarity | 25% | Easy to understand |
| Actionability | 25% | Provides clear next steps |
Step 2: Evaluate Each Dimension
Score each dimension 1-10:
## Dimension Scores
### Completeness: 8/10
- Has objectives, steps, and timeline
- Missing risk assessment section
### Feasibility: 7/10
- Most steps are achievable
- Step 3 timeline is aggressive
### Risk Mitigation: 5/10
- Only 1 risk identified
- No mitigation strategies
### Agent Coverage: 9/10
- All steps have assigned agents
- Good agent-task matching
### Integration: 8/10
Uses existing APIs
Minor compatibility concerns
**Plan Rating Request**:
