| name | skill-gap-audit |
| description | Use when auditing meteor/agent-skills for missing, incomplete, overlapping, or outdated coverage. Compares every distributable skill with a configurable Meteor checkout, changelog and release context, v3-docs, source, tests, and the latest committed audit baseline, then produces an evidence-backed report without editing skills. |
| metadata | {"internal":true} |
Audit Meteor skill gaps
Compare the published catalog with current Meteor documentation and implementation. Produce a prioritized maintenance report. Do not create or edit skills during the audit.
This workflow adapts Meteor's docs-gap and changelog skill patterns while keeping the checkout path, checked-out branch, release context, and comparison revisions configurable.
Inputs
Determine these inputs before analysis:
- Agent-skills repository root.
- Meteor source checkout.
- Audit mode: full catalog or incremental changes.
- Base and target Git revisions for an incremental audit.
- Meteor version or release context when the audit targets a release.
- Optional previous committed audit record.
- Optional output path. Return the report in the response when no path is requested.
Resolve the Meteor checkout
- Prefer a path supplied by the user or task.
- Otherwise, use
METEOR_CHECKOUT when it is set.
- Otherwise, inspect accessible workspace roots and direct sibling directories for candidates.
- Validate each candidate with
git -C <path> rev-parse --show-toplevel and require v3-docs/, packages/, and tools/. Use Git remotes to distinguish meteor/meteor or a clear fork from unrelated repositories.
- Continue automatically only when one credible candidate remains. Report its resolved path, remote, branch, commit SHA, and dirty state.
- Ask the user for a checkout path when discovery finds none or remains ambiguous. Do not assume a home directory layout or clone without authorization.
The checkout can live anywhere accessible in the current environment. Do not store its machine-specific absolute path in committed skill content.
Audit method
Read references/audit-method.md before gathering evidence. It defines committed baselines, full, release, and incremental modes, changelog and release review, deep distributable-claim comparison, and source filtering.
Build the skill inventory
For every publishable folder under skills/:
- Read the frontmatter description, tagline, kind, area, bundle membership, Meteor range, and documentation sync date.
- List the outcomes and symptoms promised by
SKILL.md.
- Map each promise to its supporting reference and evaluation case.
- Compare naming, classification, routing, structure, references, and case style with the closest neighboring skills. Treat useful local variation as intentional unless it conflicts with the repository contract or behavior.
- Note overlap with neighboring skills, promises without behavioral coverage, and classifications that do not match the skill's actual outcome or installation audience.
- Exclude folders beginning with
_ and internal .github/skills/.
Classify findings
| Classification | Meaning | Normal action |
|---|
| Covered | Current skill instructions and cases address the behavior | No change |
| Partial | Skill mentions it but lacks a decision rule, example, or evaluation | Expand existing skill |
| Outdated | Skill conflicts with current documentation or implementation | Correct and retest |
| Overlap | Multiple skills advertise the same request without clear routing | Narrow descriptions |
| Candidate | Important repeatable workflow has no suitable skill | Propose a skill |
| Documentation only | Useful fact does not justify agent workflow guidance | Leave in docs |
| Uncertain | Available evidence is missing or contradictory | Investigate and do not implement |
Propose a new skill only when it meets the threshold in skill-maintenance. Prefer expanding an existing skill when its scope already owns the user outcome.
Prioritize
Use this order:
- Incorrect security, data-access, deployment, or migration guidance.
- Removed APIs and breaking behavior.
- Advertised capabilities with no instructions or acceptance case.
- New user-facing workflows with strong skill value.
- Routing overlap and near-miss failures.
- Helpful improvements that are not release blockers.
Report
Read references/report-template.md before producing the report.
Every finding must include:
- Classification and priority.
- Affected skill or proposed scope.
- User impact.
- Evidence path, revision, and relevant symbol or section.
- Existing acceptance cases.
- Recommended action and acceptance evidence.
For full and release audits, include a claim matrix covering every distributable skill. For incremental audits, include every changed claim plus all claims affected by the Meteor diff, even when the skill file itself did not change.
Keep uncertain findings separate from confirmed gaps. State why evidence is insufficient and what would resolve it.
Handoff to skill maintenance
The audit is read-only except for writing a report to a user-requested output path. Do not update skills, metadata, branches, or GitHub state during an audit-only request.
When the user asks only for an audit, stop after the report and offer the prioritized findings for review.
When the same request explicitly asks to audit and fix:
- Finish and preserve the audit report before editing.
- Read
skill-maintenance.
- Implement only confirmed
Partial, Outdated, or Overlap findings within the authorized scope.
- Ask before creating a
Candidate skill or acting on an uncertain finding.
- Keep each change traceable to its evidence and acceptance criteria.
- Run the complete maintenance validation and report which findings were applied.