メニュー
Measure whether agent findings are actionable, accurate, and useful. Use when evaluating agent effectiveness or tuning agent prompts to reduce noise.
Codex または Claude でインストール この Prompt をコピーして Codex、Claude、または他のアシスタントに貼り付けると、Skill ページを確認してインストールできます。
SOC 職業分類に基づく
| name | agent-finding-quality |
| description | Measure whether agent findings are actionable, accurate, and useful. Use when evaluating agent effectiveness or tuning agent prompts to reduce noise. |
| license | MIT |
| compatibility | Claude Code, GitHub Copilot, OpenCode, Cursor, Codex, Gemini CLI |
| metadata | {"author":"paruff","suite":"uFawkesAI"} |
Load trigger:
"load agent-finding-quality skill"> DORA: Cap 6 (Reliability) Token cost: Low
Measure whether findings produced by agents are actually useful. A finding that is never acted on is noise. A finding that prevents a bug is gold.
agent.finding.producedEmit for each finding the agent identifies.
Attributes:
| Attribute | Type | Description |
|---|---|---|
severity | string | CRITICAL, HIGH, MEDIUM, LOW, INFO |
category | string | Skill or check category that produced this finding |
actionable | boolean | Whether this finding requires a specific action |
manual_review_needed | boolean | Whether human judgment is required |
agent.name | string | Agent that produced this finding |
session_id | string | Unique invocation identifier |
| Metric | Formula | Target |
|---|---|---|
| Actionability rate | actionable findings / total findings | > 60% |
| Manual review burden | manual_review_needed findings / total findings | < 30% |
| Blocker density | CRITICAL+HIGH findings / total invocations | < 50% |
| False positive rate | findings rejected by human / total findings | < 20% (requires human feedback) |
Generate and maintain AI_STANCE.md for any uFawkes* repo. Use when onboarding a repo to the uFawkesAI suite, when reviewing AI policy currency, or when a new AI tool is being adopted. Implements DORA AI Capability 1.
Ensure graphify corpus is current and complete before each agent session. Define minimum AI-accessible documentation per repo. Use at session startup to verify internal context is available to AI tools. Implements DORA AI Capability 3.
15-minute JTBD + acceptance criterion exercise. Use before any spec session. Produces a discovery-brief.md that anchors the entire increment to a real user need and a measurable DORA outcome. Implements DORA AI Capability 6.
Enforce minimum documentation standard across uFawkes* repos. Use when auditing a repo before release, onboarding a new repo to the suite, or implementing roadmap item 0.6 (cross-repo README links). Directly supports DORA AI Capability 3 and the 2023 DORA finding that documentation quality amplifies all technical capabilities.
Create and manage DOJO content for platform engineering education and knowledge sharing.
Maintain AI_STANCE.md as a living document. Use quarterly or when a new AI tool is adopted. Handles review triggers, the three-bucket update process, socialization checklist, and cross-repo consistency. Companion to ai-stance skill.