Skip to main content
Run any Skill in Manus
with one click

supreme-benchmarking

Stars3
Forks2
UpdatedJune 12, 2026 at 18:06

Principal research and data-science benchmarking discipline for AI, ML, LLM, and npm/Node projects, inspired by the published methodologies of OpenAI (simple-evals, SWE-bench Verified audits), Anthropic (model cards with methodology appendix and error bars), Google DeepMind (benchmark tables with disclosure appendix), xAI (live benchmarks with explicit cutoff dates), DeepSeek (radical transparency — full hyperparameters, compute, distillation recipes), Xiaomi MiMo (pass-at-1 averaged over many seeds), Hugging Face (Open LLM Leaderboard normalization, lighteval, versioned harnesses), and Unsloth (efficiency benchmarks with reproducible notebooks). Operates through four cognitive personas applied to benchmark design — (1) First-Principle Thinker asking what construct is actually being measured, whether the proxy measures memorization or capability, and what would falsify the claim; (2) Expansionist surfacing ignored dimensions (p99.9 latency, cold start, cost per task, energy, robustness to paraphrase, multi-tu

Installation

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

SKILL.md
readonly