القائمة
Run only stage 7 — emit a sibling .vortex next to each opted-in parquet. Use when the user asks to (re)convert parquet files to Vortex format without rebuilding from raw bytes.
التثبيت باستخدام Codex أو Claude انسخ هذا Prompt والصقه في Codex أو Claude أو مساعد آخر ليراجع صفحة Skill ويثبّتها لك.
استنادا إلى تصنيف SOC المهني
Walk through adding a new dataset to sources.json and producing its first build. Use when the user wants to onboard a new upstream source, add a slug to the manifest, or extend the catalog.
Walk through writing a new transform handler under scripts/pipeline/handlers/. Use when the default tighten_types/identity paths can't produce the right shape — row-level JSON parsing, streaming to avoid OOM, multi-output splitting, or VARIANT-from-the-start.
Load a Raincloud dataset via the lightweight Python loader API (`raincloud.load(slug)`). Use when the user wants to read a prepared parquet/vortex artifact, inspect a slug's metadata, or pull a dataset for downstream analysis from cache → mirror → local build.
Push locally-built Raincloud artifacts to a mirror (`scripts.pipeline.publish`). Use when the maintainer wants to upload one or more slugs' parquet/vortex bytes to a configured mirror after a successful build, gated on the snapshot's recorded sha256.
Use when the user asks to compute or refresh per-column statistics for a raincloud dataset — produces `outputs/v1/<slug>/profile.json` for the TUI's detail pane and `list_datasets --inspect`.
Run the full Raincloud pipeline (fetch → extract → parse → transform → write → validate → convert) for one or more dataset slugs. Use when the user asks to build a dataset, rebuild a slug, or process a batch.
| name | raincloud-convert |
| description | Run only stage 7 — emit a sibling .vortex next to each opted-in parquet. Use when the user asks to (re)convert parquet files to Vortex format without rebuilding from raw bytes. |
| argument-hint | <slug>... | --all |
| disable-model-invocation | true |
| allowed-tools | Bash(python -m scripts.pipeline.convert *) |
Run the convert-only entrypoint:
python -m scripts.pipeline.convert $ARGUMENTS
Selection (at least one required):
<slug>... — positional slugs--all — every dataset in the manifestBehavior:
convert.vortex: true in sources.json — others are reported as "no opt-in" and skipped.<slug>.vortex is newer than <slug>.parquet.outputs/v{n}/<slug>/vortex/<slug>.vortex.convert.vortex: true AND a hydrated parquet at outputs/v{n}/<slug>/parquet-hydrated/<slug>.parquet (produced by /raincloud-hydrate), this stage also writes outputs/v{n}/<slug>/vortex-hydrated/<slug>.vortex in the same run. Same opt-in flag governs both pairs.Known type-support gaps (vortex 0.69 — see SKILLS.md and docs/v1/vortex_skip.md):
FixedSizeBinary(N) not yet supported (blocks wikipedia-structured-contents's UUIDs; this is also why hydrate's _hydrate_provenance.sha256 is binary not fixed_size_binary[32]).Decimal128 works via the current pf.read() → vxio.write(table) path.After a convert run, suggest /raincloud-docs coverage_vortex columns_vortex to refresh the vortex-side derived docs.