triage-failure

name	triage-failure
description	Investigate a specific failed benchmark task — read logs, identify root cause, check if known pattern, suggest fix. Triggers on triage, investigate failure, debug task, diagnose failure.
user-invocable	true

Triage Failure

Investigate a failed benchmark task and produce a diagnosis.

Input

User provides one of:

• Task path: runs/official/pytorch_opus_.../baseline/.../sgt-005__hash/
• Suite/config/task: csb_sdlc_pytorch/baseline/sgt-005
• Just a task name: sgt-005 (will search for it)
• Or says "triage the most recent failure"

Steps

1. Locate the task directory

If user gave a full path, use it directly. Otherwise, find it:

cd ~/CodeScaleBench

# If "most recent failure" — get failures from aggregate_status.py
python3 scripts/aggregate_status.py --failures-only --format json | python3 -c "
import sys, json
data = json.load(sys.stdin)
tasks = [t for t in data['tasks'] if t['status'] in ('errored', 'completed_fail', 'timeout')]
tasks.sort(key=lambda t: t.get('dir_mtime', ''), reverse=True)
if tasks:
    t = tasks[0]
    print(f'Task: {t[\"task_name\"]}')
    print(f'Suite: {t[\"suite\"]}')
    print(f'Config: {t[\"config\"]}')
    print(f'Status: {t[\"status\"]}')
    print(f'Dir: {t[\"task_dir\"]}')
else:
    print('No failures found')
"

If user gave a task name, search for it:

# Find all dirs matching the task name
find runs/official - d -name  |  -10