terminal-agent-improvement-loop

name	terminal-agent-improvement-loop
description	Run a benchmark-driven improvement loop for Con's terminal agent. Use when iterating on pane awareness, SSH/tmux behavior, coding-cli flows, benchmark scoring, or progress tracking across many runs.

Terminal Agent Improvement Loop

Use this skill when improving Con as a terminal-native agent, not just fixing a one-off bug.

Primary references:

• benchmarks/terminal-agent/README.md
• docs/impl/terminal-agent-benchmark.md
• docs/impl/terminal-agent-improvement-loop.md

Workflow

1. Choose the smallest operator profile that matches the problem.
2. Run the benchmark on an idle tab:
   • python3 benchmarks/terminal-agent/run.py --profile operator-local-codex-devloop --suite operator
   • for repeated clean iterations, prefer python3 benchmarks/terminal-agent/iterate.py ...
3. Score the resulting run with the matching rubric:
   • python3 benchmarks/terminal-agent/score.py --profile ... --record ... --score ...
   • or ask the built-in agent to judge the raw record and transcript first: python3 benchmarks/terminal-agent/judge_llm.py --profile ... --record ... --socket /tmp/con.sock
   • then turn that judge artifact into a normal scorecard: python3 benchmarks/terminal-agent/score.py --profile ... --record ... --judge-file ...
4. Record one short summary, a few lessons, and a few next-focus bullets in the score record.