Menu
Analyze leaderboard score distributions, compression, selective reporting
Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.
Based on SOC occupation classification
| name | leaderboard-dynamics-analysis |
| description | Analyze leaderboard score distributions, compression, selective reporting |
| execution | subagent |
| prompt | ./prompt.md |
| input | leaderboard_data (model, score, date) |
| used-by | benchmark-archaeology |
Analyze the dynamics of benchmark leaderboards: score distributions, compression over time, selective reporting patterns, and statistical artifacts.
Leaderboard health assessment with statistical evidence.
SOTA Performance Baseline Campaign — 5 strategies for systematically collecting, standardizing, and analyzing performance data across methods. Produces standardized comparison tables, progress curves, and headroom analysis.
Assess systematic biases in the evidence body — publication bias, reporting bias, and selective outcome reporting. Budget: 40 studies, 40 effect sizes, 40 web searches.
Track evidence accumulation over time — cumulative meta-analysis protocol design. Budget: 40 studies, 40 effect sizes, 30 web searches.
Design structured data extraction form for systematic meta-analysis data collection
Systematically extract effect sizes and conditions from papers for meta-analytic synthesis
Determine effect size types and calculation methods for meta-analytic synthesis
