Skip to main content

microsoft/benchmark-qed

Latest recorded source activity
SkillsMP catalog refreshed
skills collected
3
GitHub stars
104
GitHub forks
24

Install with an AI assistant

Copy this prompt into the AI assistant you're using.

Loading the repository README…

Skills in this repository

1 occupation category · 33% classified

Showing 3 of 3 collected skills.

occupation
unclassified
description

Evaluate RAG system outputs using benchmark-qed scoring methods. Use when: running pairwise comparisons, reference-based scoring, assertion-based evaluation (flat or hierarchical), retrieval metrics, or statistical significance tests on RAG outputs. Also use…

updated
occupation
unclassified
description

Initialize and configure benchmark-qed workspaces for RAG benchmarking. Use when: setting up a new benchmarking project, initializing config files for question generation or evaluation, downloading sample datasets, or modifying benchmark-qed settings.yaml…

updated
occupation
Data Scientists
description

Generate benchmark questions and assertions from input data using benchmark-qed. Use when: generating local, global, linked, or activity questions for RAG benchmarking, creating assertions for existing questions, computing assertion statistics, or running the…

updated
Showing 3 of 3 collected skills.