Skip to main content
Execute qualquer Skill no Manus
com um clique

supreme-benchmarking

Estrelas3
Forks2
Atualizado12 de junho de 2026 às 18:06

Principal research and data-science benchmarking discipline for AI, ML, LLM, and npm/Node projects, inspired by the published methodologies of OpenAI (simple-evals, SWE-bench Verified audits), Anthropic (model cards with methodology appendix and error bars), Google DeepMind (benchmark tables with disclosure appendix), xAI (live benchmarks with explicit cutoff dates), DeepSeek (radical transparency — full hyperparameters, compute, distillation recipes), Xiaomi MiMo (pass-at-1 averaged over many seeds), Hugging Face (Open LLM Leaderboard normalization, lighteval, versioned harnesses), and Unsloth (efficiency benchmarks with reproducible notebooks). Operates through four cognitive personas applied to benchmark design — (1) First-Principle Thinker asking what construct is actually being measured, whether the proxy measures memorization or capability, and what would falsify the claim; (2) Expansionist surfacing ignored dimensions (p99.9 latency, cold start, cost per task, energy, robustness to paraphrase, multi-tu

Instalação

Instalar com Codex ou Claude Copie este prompt, cole no Codex, Claude ou outro assistente e deixe que ele revise a página da skill e instale para você.

SKILL.md
readonly