Daily triage accuracy calibration — use during scheduled calibration runs to verify triage classification accuracy against few-shot examples and adjust confidence thresholds
Installation
Installer avec Codex ou Claude Copiez ce prompt, collez-le dans Codex, Claude ou un autre assistant, puis laissez-le vérifier la page du skill et l'installer pour vous.
Daily triage accuracy calibration — use during scheduled calibration runs to verify triage classification accuracy against few-shot examples and adjust confidence thresholds
consumer
daily_calibration
phase
6
skill_type
hybrid
Triage Calibration
Purpose
Review recent triage decisions against actual outcomes. Adjust signal weights
and depth thresholds to improve classification accuracy over time.
When to Use
Scheduled daily (end of day or low-activity period).
After a significant misclassification is identified.
After a new signal collector is added or modified.
Workflow
Collect recent triage results — Pull the last 24h of awareness ticks
with their depth classifications and signal readings.
Match against outcomes — For each tick, determine what actually happened:
Did the classified depth match the actual work required?
Were any signals misleadingly high or low?
Compute accuracy metrics —
Classification accuracy (correct depth / total ticks)
Over-triage rate (classified higher than needed)
Under-triage rate (classified lower than needed)
Identify systematic errors — Are certain signal types consistently
miscalibrated? Are certain time periods problematic?
Propose adjustments — Suggest weight or threshold changes. Do NOT
auto-apply in V3 (fixed weights). Log recommendations for user review.
