crud-archive-run

name

crud-archive-run

description

Durably ARCHIVE everything informative from a finished run / experiment before it's cleaned up or its cluster artifacts age out — ALL Harbor trace_jobs (raw per-trial traces), ALL ray logs, ALL stdout/stderr (incl. vLLM/serving logs), and wandb. Pack-rat by design: if it's potentially informative, keep it. Only skip the non-informative-or-huge (model weights/checkpoints, core/memory dumps, massive raw tmux-pane / terminal-recording bytes). Many-tiny-files → tar THEN rsync (never rsync thousands of small files raw). Use when concluding/archiving an experiment, before a cleanup skill `rm`s an on-disk tree, or before CoreWeave R2/pod artifacts get GC'd. Per-run-type component maps live below; WHERE each artifact lives per cluster is a pointer into `.agents/ops/<cluster>/` and `.agents/projects/{harbor,marinskyrl,ot-agent}/`.

crud-archive-run

Archive potentially informative artifacts; skip only files that are both non-informative and large.

✅ ARCHIVE (always — every run type)

• All raw Harbor traces — every per-trial dir under trace_jobs/ (RL) / eval_jobs/<name>/ (eval) / the datagen trace dir: result.json, config.json, manifest.json, lock.json, agent/trajectory.json (the raw agent transcript — INFORMATIVE, keep even at multi-MB), verifier/ (reward.txt, ctrf.json, test-stdout.txt), step_results, trajectory.summarization-*.json.
• All ray logs — the ray session dir (raylet, gcs_server, per-worker *.out/*.err, python-core-*).
• All stdout / stderr — SLURM .out/.err, the complete CoreWeave finelog, , , and per-trial .