arbor-agent-merge-eval

name	arbor-agent-merge-eval
description	Merge and evaluation discipline for Arbor. Use for TreeSetMeta metadata, B_dev/B_test separation, eval command templates, score parsing, GitMergeBranch behavior, protected paths, required outputs, metric_direction, trunk/test score updates, medal detection, and final evaluation before stopping.

Arbor Merge And Eval

Use this whenever scores, metadata, merge decisions, or final validation are involved.

Dataset Discipline

• B_dev is for routine iteration, executor experiments, score tracking, and idea selection.
• B_test is for milestone checks only: before merging a branch and at final report time.
• If B_test diverges from B_dev, do not hand-wave it. Investigate overfitting, noise, data split mismatch, or eval contamination.

Tree Metadata

Persist evaluation metadata early and update it after merges:

• baseline_score: unmodified B_dev score.
• trunk_score: current trunk B_dev score.
• test_baseline_score: unmodified B_test score.
• test_trunk_score: current trunk B_test score.
• eval_cmd: B_dev command.
• eval_cmd_test: B_test command.
• eval_timeout, eval_retries, eval_retry_base_delay, eval_retry_max_delay.
• dataset_info: paths and split descriptions.
• metric_direction: maximize or minimize.
• trunk_branch: non-protected branch that receives verified merges.
• submission_path, sample_submission_path.