| name | documentation-audit |
| description | Assess documentation completeness against BetterBench/Datasheets standards |
| execution | subagent |
| prompt | ./prompt.md |
| input | benchmark_documentation |
| used-by | benchmark-archaeology |
Documentation Audit SOP
Assess benchmark documentation completeness against established standards: BetterBench 46-criterion framework, Datasheets for Datasets, and Data Statements for NLP.
Input
- benchmark_documentation: All available documentation for the benchmark (paper, README, website, datasheet)
Procedure
- Check documentation against BetterBench 46 criteria
- Check against Datasheets for Datasets questions
- Identify critical missing information
- Assess reproducibility from documentation alone
- Grade overall documentation quality
Output
Documentation completeness score with per-criterion pass/fail and prioritized gaps.