Evaluate RAG system outputs using benchmark-qed scoring methods. Use when: running pairwise comparisons, reference-based scoring, assertion-based evaluation (flat or hierarchical), retrieval metrics, or statistical significance tests on RAG outputs. Also use…
microsoft/benchmark-qed
- Latest recorded source activity
- SkillsMP catalog refreshed
- skills collected
- 3
- GitHub stars
- 104
- GitHub forks
- 24
Install with an AI assistant
Copy this prompt into the AI assistant you're using.
Follow https://skillsmp.com/skill-install/prompt.md to install Agent Skills from https://github.com/microsoft/benchmark-qed.Loading the repository README…
Skills in this repository
1 occupation category · 33% classified
Showing 3 of 3 collected skills.
skill
occupation
description
updated
occupation
unclassified
description
updated
occupation
unclassified
description
Initialize and configure benchmark-qed workspaces for RAG benchmarking. Use when: setting up a new benchmarking project, initializing config files for question generation or evaluation, downloading sample datasets, or modifying benchmark-qed settings.yaml…
updated
occupation
Data Scientists
description
Generate benchmark questions and assertions from input data using benchmark-qed. Use when: generating local, global, linked, or activity questions for RAG benchmarking, creating assertions for existing questions, computing assertion statistics, or running the…
updated
Showing 3 of 3 collected skills.