Run any Skill in Manus with one click

raincloud-convert

Stars4

Forks0

UpdatedMay 16, 2026 at 22:26

Run only stage 7 — emit a sibling .vortex next to each opted-in parquet. Use when the user asks to (re)convert parquet files to Vortex format without rebuilding from raw bytes.

Installation

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

Run Skill in Manus

Source

spiraldb

spiraldb/raincloud

View GitHub Repository View Creator Repositories

Download

Run Skill in Manus

Related occupationsSOC

Based on SOC occupation classification

Database ArchitectsComputer and Mathematical Occupations·SOC 15-1243

SKILL.md

readonly

name	raincloud-convert
description	Run only stage 7 — emit a sibling .vortex next to each opted-in parquet. Use when the user asks to (re)convert parquet files to Vortex format without rebuilding from raw bytes.
argument-hint	<slug>... \| --all
disable-model-invocation	true
allowed-tools	Bash(python -m scripts.pipeline.convert *)

Run the convert-only entrypoint:

python -m scripts.pipeline.convert $ARGUMENTS

Selection (at least one required):

<slug>... — positional slugs
--all — every dataset in the manifest

Behavior:

Only acts on specs that have convert.vortex: true in sources.json — others are reported as "no opt-in" and skipped.
Idempotent: skips when <slug>.vortex is newer than <slug>.parquet.
Writes the base vortex at outputs/v{n}/<slug>/vortex/<slug>.vortex.
Hydrated companion: when a slug has both convert.vortex: true AND a hydrated parquet at outputs/v{n}/<slug>/parquet-hydrated/<slug>.parquet (produced by /raincloud-hydrate), this stage also writes outputs/v{n}/<slug>/vortex-hydrated/<slug>.vortex in the same run. Same opt-in flag governs both pairs.

Known type-support gaps (vortex 0.69 — see SKILLS.md and docs/v1/vortex_skip.md):

FixedSizeBinary(N) not yet supported (blocks wikipedia-structured-contents's UUIDs; this is also why hydrate's _hydrate_provenance.sha256 is binary not fixed_size_binary[32]).
VARIANT columns surface as their shredded struct on round-trip — size blow-up on heavily-nested payloads.
Per-file overhead dominates on very small parquets — size ratio can exceed 1.0 under a few MB.
Decimal128 works via the current pf.read() → vxio.write(table) path.

After a convert run, suggest /raincloud-docs coverage_vortex columns_vortex to refresh the vortex-side derived docs.

More from this repository

same repository

raincloud-add-dataset

spiraldb/raincloud

Walk through adding a new dataset to sources.json and producing its first build. Use when the user wants to onboard a new upstream source, add a slug to the manifest, or extend the catalog.

2026-05-294

raincloud-add-handler

spiraldb/raincloud

Walk through writing a new transform handler under scripts/pipeline/handlers/. Use when the default tighten_types/identity paths can't produce the right shape — row-level JSON parsing, streaming to avoid OOM, multi-output splitting, or VARIANT-from-the-start.

2026-05-294

raincloud-load

spiraldb/raincloud

Load a Raincloud dataset via the lightweight Python loader API (`raincloud.load(slug)`). Use when the user wants to read a prepared parquet/vortex artifact, inspect a slug's metadata, or pull a dataset for downstream analysis from cache → mirror → local build.

2026-05-294

raincloud-publish

spiraldb/raincloud

Push locally-built Raincloud artifacts to a mirror (`scripts.pipeline.publish`). Use when the maintainer wants to upload one or more slugs' parquet/vortex bytes to a configured mirror after a successful build, gated on the snapshot's recorded sha256.

2026-05-294

raincloud-profile

spiraldb/raincloud

Use when the user asks to compute or refresh per-column statistics for a raincloud dataset — produces `outputs/v1/<slug>/profile.json` for the TUI's detail pane and `list_datasets --inspect`.

2026-05-174

raincloud-build

spiraldb/raincloud

Run the full Raincloud pipeline (fetch → extract → parse → transform → write → validate → convert) for one or more dataset slugs. Use when the user asks to build a dataset, rebuild a slug, or process a batch.

2026-05-164

name	raincloud-convert
description	Run only stage 7 — emit a sibling .vortex next to each opted-in parquet. Use when the user asks to (re)convert parquet files to Vortex format without rebuilding from raw bytes.
argument-hint	<slug>... \| --all
disable-model-invocation	true
allowed-tools	Bash(python -m scripts.pipeline.convert *)

Run the convert-only entrypoint:

python -m scripts.pipeline.convert $ARGUMENTS

Selection (at least one required):

<slug>... — positional slugs
--all — every dataset in the manifest

Behavior:

Only acts on specs that have convert.vortex: true in sources.json — others are reported as "no opt-in" and skipped.
Idempotent: skips when <slug>.vortex is newer than <slug>.parquet.
Writes the base vortex at outputs/v{n}/<slug>/vortex/<slug>.vortex.
Hydrated companion: when a slug has both convert.vortex: true AND a hydrated parquet at outputs/v{n}/<slug>/parquet-hydrated/<slug>.parquet (produced by /raincloud-hydrate), this stage also writes outputs/v{n}/<slug>/vortex-hydrated/<slug>.vortex in the same run. Same opt-in flag governs both pairs.

Known type-support gaps (vortex 0.69 — see SKILLS.md and docs/v1/vortex_skip.md):

FixedSizeBinary(N) not yet supported (blocks wikipedia-structured-contents's UUIDs; this is also why hydrate's _hydrate_provenance.sha256 is binary not fixed_size_binary[32]).
VARIANT columns surface as their shredded struct on round-trip — size blow-up on heavily-nested payloads.
Per-file overhead dominates on very small parquets — size ratio can exceed 1.0 under a few MB.
Decimal128 works via the current pf.read() → vxio.write(table) path.

After a convert run, suggest /raincloud-docs coverage_vortex columns_vortex to refresh the vortex-side derived docs.