Skip to main content

autoresearch-create

Set up and run an autonomous experiment loop for any optimization target. Use when asked to run autoresearch, optimize something repeatedly, start benchmark-driven experiments, or resume an existing .auto session.

跳到安装

来源信息

仓库
scaryrawr/scarypilot
最近来源活动
2026年9月14日 20:39
检测到的 SKILL.md 语言
英语
星标
4
分支
0

安装方式

默认使用会先检查来源的 Prompt;你也可以切换为直接命令,或下载本地副本。

检查来源文件

决定是否安装前,请先阅读 SKILL.md,以及 SkillsMP 当前展示的配套文件。

文件资源管理器
2 个文件

正在显示 SKILL.md

SKILL.md
来源说明 · 只读预览
name
autoresearch-create
description
Set up and run an autonomous experiment loop for any optimization target. Use when asked to run autoresearch, optimize something repeatedly, start benchmark-driven experiments, or resume an existing .auto session.
# Create an autoresearch session Build a durable experiment loop that can survive context resets and restarts. 1. Infer or gather the goal, benchmark command, primary metric and direction, files in scope, and correctness constraints. 2. Create a branch named `autoresearch/<goal>-<date>`. 3. Read and understand the relevant implementation before changing it. 4. Read [references/session-design.md](references/session-design.md). 5. Create `.auto/prompt.md` and `.auto/measure.sh`. Add `.auto/checks.sh` only when correctness constraints need a separate gate. 6. Make scripts executable and commit the initial session files before the baseline so discard can safely restore the tree. 7. Call `init_experiment`, run and log the baseline, then iterate immediately. ## `.auto/prompt.md` Write a self-contained playbook that a fresh agent can use without conversation history. Include: - objective; - primary and secondary metrics; - `./.auto/measure.sh` usage; - files in scope and off limits; - correctness and dependency constraints; - a “What’s Been Tried” section that is maintained during the loop. ## `.auto/measure.sh` Use `set -euo pipefail`. Run fast pre-checks, then the benchmark, and print one or more `METRIC name=value` lines. The primary name must exactly match `init_experiment.metric_name`. For fast noisy workloads, take multiple samples and report the median. ## Loop rules - Always call `log_experiment` after `run_experiment`. - Keep primary-metric improvements; discard regressions or equal results. - Include useful `asi` on every run. On discard or crash, preserve the failed hypothesis, rollback reason, and next action because the code will disappear. When retrying a discarded idea after its assumptions changed, set `asi.revisits_run` to the earlier run number and explain what changed — don't revive a discarded idea without a changed assumption. - Append deferred ideas to `.auto/ideas.md`. - Update `.auto/prompt.md` as durable knowledge accumulates. - Treat confidence as advisory: re-run improvements inside the noise floor. - Prefer simpler changes and structural hypotheses over repeated parameter tweaks. - Continue until interrupted, a configured limit is reached, or the repeated failure guard stops the loop. - If the user sends feedback during a run, finish and log that run before incorporating the feedback.
在 GitHub 查看