rag-evaluation
Use when modifying retrieval, chunking, RRF, rerank, citation, answer grounding, or evaluation scripts.
Source facts
- Repository
- lennney/ticketpilot
- Last source activity
- April 28, 2026 at 17:04
- Detected SKILL.md language
- English
- Stars
- 1
- Forks
- 1
Install options
The review-first prompt is selected by default. You can switch to a direct command or download a local copy.
Review the source files
Read SKILL.md and any companion files shown by SkillsMP before deciding whether to install.
Showing SKILL.md
SKILL.md
Source instructions · Read-only preview- name
- rag-evaluation
- description
- Use when modifying retrieval, chunking, RRF, rerank, citation, answer grounding, or evaluation scripts.
# RAG Evaluation
Required metrics:
- Recall@3
- Recall@5
- MRR
- citation correctness
- evidence support rate
- unsupported claim rate
Rules:
1. Do not use vector-only retrieval for the MVP.
2. Keep FAQ, Policy, and Case source types visible in retrieval outputs.
3. Retrieval trace must preserve query, keyword results, vector results, fused results, final evidence, scores, doc_type, and source ids.
4. Do not claim improvement without running evaluation.
View on GitHub