Run any Skill in Manus with one click

tcfuse-preprocess

Stars0

Forks0

UpdatedJune 9, 2026 at 12:02

TC-Fuse dataset preprocessing pipeline — Stage 0 IBTrACS prep + ATCF→SID translation table, Stage 1 per-source HDF5 snapshots, Stage 2 assembled per-storm HDF5 + concatenated index, Stage 3A season splits, Stage 3B window index building, normalization statistics, the I/O API in `src/tcfuse/data/sources/`. Use when preparing any dataset (TC-PRIMED, CyclObs, dropsondes, Argo), running `prepare_ibtracs.py` / `assemble.py` / `build_splits.py` / `build_windows.py` / `compute_normalization.py`, working with `Source` or `StormData`, or extending the per-source HDF5 / assembled formats.

Installation

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

Run Skill in Manus

Source

dauvillc

dauvillc/tcfuse

View GitHub Repository View Creator Repositories

Download

Run Skill in Manus

Related occupationsSOC

Based on SOC occupation classification

Software DevelopersComputer and Mathematical Occupations·SOC 15-1252

SKILL.md

readonly

name

tcfuse-preprocess

description

Content has moved. The full skill documentation is in .agents/preprocess.md. Read that file for pipeline stages, dataset inventory, HDF5 schemas, running instructions, and the I/O API reference.

More from this repository

same repository

tcfuse-sweep

dauvillc/tcfuse

TC-Fuse hyperparameter search — Hydra Optuna sweeper + submitit launcher running parallel single-GPU SLURM trials (offline-safe, works on Jean-Zay). Search space in conf/hydra/sweeper/*.yaml; launcher SLURM spec in conf/hydra/launcher/jz_*_sweep.yaml; short-budget experiment in conf/experiment/pmw_gmi_sweep.yaml. With submitit=false, scripts/train/train.py returns the best val/loss as the objective Optuna minimizes. Respect the Perceiver's head-divisibility invariants when defining the space. Use when running a sweep, adding a search space, or changing the optimized metric.

2026-06-300

tcfuse-evaluate

dauvillc/tcfuse

TC-Fuse evaluation pipeline — computing metrics and building figures from saved predictions with `scripts/evaluation/evaluate.py` (Hydra, `conf/evaluation.yaml`). Plugin-based: each `Evaluation` (`src/tcfuse/evaluation/`) is enabled via the `conf/evaluation/` config group and writes into its own subfolder under `paths.results/<run_id>/<experiment_name>/`. The base contract imposes no data shape (flattening is plugin-dependent); the `quantitative_metrics` plugin computes RMSE/MAE/R2/MAPE per source/channel with numpy/scikit-learn, independent of torchmetrics. Use when evaluating a prediction run, adding a new evaluation plugin, or changing the results layout.

2026-06-290

tcfuse-inference

dauvillc/tcfuse

TC-Fuse inference and prediction pipeline — running a trained checkpoint over a split with `scripts/inference/infer.py` (Hydra, `conf/inference.yaml`), the single-GPU `trainer.predict` flow with task-specific target masking, the `PredictionWriter` callback, and the `SamplePrediction` / `PredictionRun` output format (per-window HDF5 + `index.parquet` + `manifest.yaml`) with its `compute_metrics` evaluation (bias, RMSE, MAE, R2 per channel). Use when running inference, evaluating a checkpoint, changing the prediction output format, or working in `src/tcfuse/data/predictions/` or `src/tcfuse/lightning/prediction_writer.py`.

2026-06-280

tcfuse-cleps

dauvillc/tcfuse

Drive the CLEPS (Inria Paris) cluster from the local machine — rsync sync, preflight, SLURM submission via submitit, job monitoring, checkpoint resume, and storage quota. Use whenever a task involves `ssh cleps`, $SCRATCH, CLEPS SLURM partitions (cpu_devel / gpu / arches), pixi on the cluster, `submitit`, `setup=cleps_*`, `paths=cleps`, or running jobs on CLEPS. CLEPS uses pixi (no modules) and W&B online (no offline sync), and its scratch is persistent (no archive step).

2026-06-250

tcfuse-architecture

dauvillc/tcfuse

TC-Fuse model backbone design — the architecture-agnostic embedding layer (TorchSource → EmbeddedSource via MultiSourceEncoder) and un-embedding layer (EmbeddedBatch → DecodedBatch via MultiSourceDecoder), the swappable encoder interface, candidate backbones to benchmark (Perceiver, cross-attention Transformer, hierarchical windowed attention), and the masked-source-reconstruction self-supervised pre-training task. Use when working in `src/tcfuse/models/`, adding or benchmarking a backbone, or changing the encoder/decoder interface.

2026-06-230

pyright-typing-fixer

dauvillc/tcfuse

Fix basedpyright diagnostics with clean, minimal Python typing changes. Use when the user mentions Pyright, basedpyright, type errors, typing fixes, type checking, or Python typing diagnostics.

2026-06-090

name

tcfuse-preprocess

description

Content has moved. The full skill documentation is in .agents/preprocess.md. Read that file for pipeline stages, dataset inventory, HDF5 schemas, running instructions, and the I/O API reference.