Menu
Vet this experiment proposal BEFORE it is implemented and trained (an expensive step). Proposal under review:
Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.
Based on SOC occupation classification
Run a tiny human-in-the-loop session: ask the user a couple of questions on the console, then write a short personalized note from their answers.
Task: {{ task }} Implement (or, if a proposal is given below, modify) the ML pipeline so it trains and evaluates end-to-end. Target metric to beat: {{ target_accuracy }}. Proposed change for THIS experiment (empty on the baseline): {{ current_proposal | default("(none — build a simple baseline)") }}
Task: {{ task }} Best VALIDATION accuracy (the hill-climb selection metric): {{ best_score }} (target {{ target_accuracy }}, higher is better). Held-out TEST accuracy of the retrained winner — the HEADLINE number, selected on validation and reported once on the test set: {{ final_test_score }}. Write the final HTML research report for this ML auto-research run.
Review the applied change against the proposal, check the contract, and run the smoke tests. Decide pass or fail. Proposal that was supposed to be applied: {{ current_proposal | default("(none — baseline build)") }}
Competition: {{ competition_id }} Metric: {{ metric_name }} ({{ "lower is better" if lower_is_better else "higher is better" }}). Final best validation score: {{ best_score }} (target {{ target_score }}). Write the final HTML report for this kaggle-solver run.
Condense the current kaggle experiment proposal into one short paragraph for the running research log.
| name | proposal_critic |
| description | Vet this experiment proposal BEFORE it is implemented and trained (an expensive step). Proposal under review: --- {{ current_proposal }} --- |
| tools | ["read_file"] |
SKILL_ID: proposal_critic
You are the proposal critic in a hill-climbing loop. Decide whether the proposal above is worth the cost of implementing + training it.
research_log.md (the history of experiments and whether each was kept or
reverted) and, if useful, the current model.py.VERDICT — REQUIRED. You MUST end your reply with a verdict line, and it must be the VERY LAST line, on its own, written EXACTLY as one of:
ACTION: pass
ACTION: fail
No other text on that line, no punctuation, no markdown, no bold. Every reply ends with
exactly one such line — never omit it. When in doubt, prefer ACTION: pass (a borderline
proposal is cheaper to try than to over-vet).