메뉴
Route RAG evaluation work across retrieval metrics, generation quality, and end-to-end evaluation frameworks.
Codex 또는 Claude로 설치 이 Prompt를 복사해 Codex, Claude 또는 다른 어시스턴트에 붙여 넣으면 Skill 페이지를 검토하고 설치를 진행할 수 있습니다.
Use this skill when building, debugging, or improving Retrieval-Augmented Generation systems, including chunking, vector database selection, hybrid search, reranking, multimodal RAG, code documentation RAG, retrieval latency, and production RAG architecture.
Chunk nested documents into parent-child levels so retrieval can move from broad sections to fine-grained passages.
Use semantic boundaries and embedding similarity to chunk text for higher-relevance retrieval.
Route RAG chunking decisions across semantic, hierarchical, sliding-window, contextual-header, and framework-selection strategies.
Use overlapping windows to preserve context across chunk boundaries while controlling retrieval size.
Reduce retrieval latency with caching, batching, and index-level optimization.
SOC 직업 분류 기준
| name | evaluation-metrics |
| title | Evaluation Metrics |
| description | Route RAG evaluation work across retrieval metrics, generation quality, and end-to-end evaluation frameworks. |
| category | evaluation-metrics |
| tags | ["evaluation","metrics","ragas","routing"] |
| allowed-tools | ["Read","Grep","Glob"] |
Use this parent skill when the main RAG problem is measuring quality, detecting regressions, or proving that a change actually helped. Route to the child skill that matches whether the failure is in retrieval, in generation, or in the evaluation harness itself.
Teams ship RAG changes with no baseline, tune on vibes, and cannot tell whether a new chunker, embedding model, or prompt made things better or worse. Without metrics, retrieval and generation regressions ship silently and are only caught by users.
Measure retrieval and generation separately. Bad answers from good context are a generation problem; good answers are impossible from bad context.
Use retrieval metrics when the right chunks are missing or mis-ranked, and generation metrics when context is good but answers are wrong, unsupported, or off-topic.
Build a golden set, run the metrics on every change, and block merges that regress the baseline instead of evaluating manually.
