firstbatchxyz/adopt-bench

adoptbench

Tool surface for working in a adopt-bench synthetic GitHub organization. Use these when you need to read or modify the repository, list issues / PRs, open or update a PR, or comment on the team.

byor-checks

Turn a repo's house conventions into mechanical adopt-bench convention checks with REQUIRED fixture tests, then gate every generated task through lc-audit (the BenchGuard 2×2, cross-provider) before the owner approves it.

byor-env

Stand up the run environment for a BYOR schedule — export it to a Harbor task, optionally wire an owner-supplied test_command for execution-verified grading, and prove it with an oracle smoke before any paid agent run.

byor-review

Run a blind pairwise preference session over same-issue diffs from different agents/arms — "which PR would you merge?" — to produce an Elo/Bradley-Terry ranking and a human-vs-judge calibration number.

byor-setup

Build a adopt-bench learning-curve schedule from a repo the owner brings — interview them, mine issue↔merged-fix-PR pairs, synthesize leak-free prompts, calibrate difficulty with lc-ladder, and emit a schedule JSON ready for byor-checks.