test-skill

name	test-skill
description	Run trigger accuracy and output quality tests against a skill — measure activation rate on labeled eval queries and verify output on golden scenarios. Use before publishing a skill, checking for regressions, or in CI, even if the user just says "test my skill" or "does this skill work?"

Test Skill

Overview

A skill has two testable properties:

Property	File	Question
Trigger accuracy	evals/trigger-queries.json	Does it fire when it should, and stay silent when it shouldn't?
Output quality	evals/evals.json	When activated, does it produce the right result?

Run both. Either can block a publish.

---

Instructions

1. Locate the skill

Determine the skill path from the user's input:

Placement	Location
Project public	skills/<name>/
Project private	.agents/skills/<name>/
User	~/.agents/skills/<name>/

If no path is given, audit the skill named by the user across all three locations.

2. Trigger accuracy test

Read evals/trigger-queries.json. If the file does not exist, skip to step 3 and note the gap.

Expected format:

{
  "skill_name":