| name | papers-audit-metadata-consistency |
| follows | rf-obsidian-markdown |
| status | local-export-audit |
| description | Runs a unified metadata consistency audit across obsidian-vault/analysis logs and analysis notes, checking title/venue/year consistency, link/pdf_ref completeness, duplicates, and structure anomalies; writes quality_report_*.md under obsidian-vault/batches/reports. |
Metadata Consistency Audit
What this skill does
Runs one unified audit entry for step5 quality governance:
- checks
obsidian-vault/paper_list.csv and legacy list/log entries when present;
- checks
obsidian-vault/analysis/**/*.md analysis notes;
- checks cross-layer consistency between log/list and analysis notes;
- outputs
obsidian-vault/batches/reports/quality_report_*.md (optionally .json).
Coverage
This skill covers structural and metadata hygiene only.
- title / venue / year consistency
- link completeness (
paper_link, project_link/github_link, pdf_ref)
- duplicate paper detection in txt logs
- analysis note structure anomalies (missing frontmatter keys, missing semantic analysis sections)
- unmatched records (
only-in-txt, only-in-md)
Current limits
- does not evaluate whether conclusions are sufficiently supported by evidence
- does not score citation quality in idea notes or share notes
- does not audit completeness of comparison tables or downstream summaries
- does not detect stale analyses that should be refreshed
- broader semantic-layer governance belongs to a future knowledge-hygiene / evidence-governance extension
Run
From the repository root:
python3 .claude/skills/papers-audit-metadata-consistency/scripts/audit_metadata_consistency.py
Optional JSON output:
python3 .claude/skills/papers-audit-metadata-consistency/scripts/audit_metadata_consistency.py --json
Output
obsidian-vault/batches/reports/quality_report_<YYYY-MM-DD_HHMM>.md- optional
obsidian-vault/batches/reports/quality_report_<YYYY-MM-DD_HHMM>.json
When to use
- after collect/download/analyze batches
- before rebuilding indexes
- periodic KB quality checks for open-source readiness
