| name | raincloud-list-datasets |
| description | Filter and list datasets from sources.json without grepping a 545 KB JSON file. Use when the user asks "which slugs use handler X", "show me all UCI datasets", "what's gated behind Kaggle ToS", or any other catalog-shape question that's faster than reading docs/v1/datasets.md end to end. |
Run the catalog-query CLI:
python -m scripts.pipeline.list_datasets $ARGUMENTS
Read-only — never touches outputs/ or _workdir/. Sub-second on the full manifest.
Filters (compose with AND):
| Flag | Filter |
|---|
--handler <h> | transform.handler exact match (e.g. tighten_types, glove_split, uci_default) |
--license <spdx> | license.spdx exact match (e.g. CC0-1.0, Apache-2.0) |
--fetch-type <t> | fetch.type ∈ http, kaggle, huggingface, custom |
--reader <r> | parse.reader ∈ csv, parquet, jsonl, xml, pbf, custom |
--vortex / --no-vortex | convert.vortex is true / false (mutually exclusive) |
--kaggle-tos | only Kaggle specs gated behind a one-time click-through |
--grep <pattern> | regex over slug + short_name + full_name + description (case-insensitive) |
Output modes (default = one slug per line):
--long — wide table with slug, handler, fetch type, reader, license, row count, vortex flag.--json — one JSON object per matching dataset (pipe into jq for further filtering).--count — just the count of matches.
Common shapes:
python -m scripts.pipeline.list_datasets --fetch-type kaggle --kaggle-tos
python -m scripts.pipeline.list_datasets --handler wikipedia_variant_parse --long
python -m scripts.pipeline.list_datasets --reader csv --vortex --count
python -m scripts.pipeline.list_datasets --grep '\bgeo' --long
Pair with /raincloud-status <slug> to check filesystem state of any returned slug, and /raincloud-validate-manifest after editing the manifest based on findings.
Context: SKILLS.md, sources.schema.md, docs/v1/datasets.md for full-row metadata.
New discovery axes (0.1.4)
--showcase, --tag, --size, --trait, --view, --inspect, --tags-help, --showcase-help. See the raincloud-discover skill for the full vocabulary and patterns.
