菜单
Monitor AI benchmark competitors weekly including SWE-bench, HumanEval, LiveCodeBench, Aider, CodeClash, and new entrants — tracking methodology changes, adoption, community growth, and market signals that should feed into Bouts content, positioning, or feature decisions.
用 Codex 或 Claude 帮你安装 复制这段 Prompt，粘贴到 Codex、Claude 或其他助手里，让它检查 Skill 页面并帮你完成安装。
基于 SOC 职业分类
Internal admin tools for inspecting, monitoring, and improving judge outputs — including raw output inspection, calibration drift detection, missing evidence detection, low-signal output flagging, and a feedback quality dashboard.
Block filler, detect low-signal text, score specificity, and enforce evidence-anchored observations across all LLM-generated feedback in Bouts — with banned phrase detection, specificity scoring, retry-with-critique, and dimension name normalization.
Generate insights comparing an agent's performance to top performers, peers, and their own history — only from real data with minimum sample guards, including percentile comparisons, counterfactual rank calculation, and "surprisingly strong" lane detection.
Evaluation-specific visualization patterns for Bouts — radar charts, multi-judge comparison bars, rank distribution dots, confidence overlays, and percentile bands using Recharts with full accessibility and missing-data handling.
What users actually need after losing or winning a competitive AI evaluation — emotional state design for winners, close misses, and clear losses, with TSX layout and copy patterns that make feedback feel fair rather than algorithmic.
Expose when a judgment is high-confidence vs thin-evidence without undermining the platform's authority — covering the confidence trilemma, per-tier UI patterns, data model, copy patterns, and hard rules on when NOT to show confidence indicators.
| name | competitor-monitoring |
| description | Monitor AI benchmark competitors weekly including SWE-bench, HumanEval, LiveCodeBench, Aider, CodeClash, and new entrants — tracking methodology changes, adoption, community growth, and market signals that should feed into Bouts content, positioning, or feature decisions. |
| Competitor | What to track | Where |
|---|---|---|
| SWE-bench | New versions, methodology changes, adoption | GitHub, papers, X |
| HumanEval+ | Updates, new tasks, citations | GitHub, papers |
| LiveCodeBench | New tasks, methodology updates | GitHub, blog |
| Aider benchmark | New features, agent support changes | GitHub |
| CodeClash | Format changes, community growth | Website, X |
| Any new AI benchmarks | Launch announcements | X, HN, Product Hunt, arXiv |
COMPETITIVE BRIEF — Week [N]
New developments:
- [Competitor]: [what changed] [significance: high/medium/low]
Content opportunities:
- [idea]
Feature gaps to consider:
- [gap]
No action needed:
- [item] — [reason]