Run any Skill in Manus with one click

normalize-skos

Stars1

Forks0

UpdatedJune 9, 2026 at 12:28

Use when fetching, parsing, normalizing, or canonicalizing a SKOS scheme into N-Quads in skosdex — i.e. running the scripts/skosdex fetch/normalize/canonicalize pipeline or debugging its normalized.nq.gz / canonical.nq.gz output, including the gzip + Git LFS storage and zip/gz source decompression.

Installation

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

Run Skill in Manus

Source

danbri

danbri/skosdex

View GitHub Repository View Creator Repositories

Download

Run Skill in Manus

Related occupationsSOC

Based on SOC occupation classification

Software DevelopersComputer and Mathematical Occupations·SOC 15-1252

SKILL.md

readonly

name	normalize-skos
description	Use when fetching, parsing, normalizing, or canonicalizing a SKOS scheme into N-Quads in skosdex — i.e. running the scripts/skosdex fetch/normalize/canonicalize pipeline or debugging its normalized.nq.gz / canonical.nq.gz output, including the gzip + Git LFS storage and zip/gz source decompression.
license	Apache-2.0

Normalize & canonicalize a scheme

scripts/skosdex (Node, ESM; deps: n3, rdf-canonize) turns each scheme's source RDF into two gzipped artifacts in its folder:

normalized.nq.gz — parsed, sorted, de-duplicated N-Quads (build artifact, gitignored).
canonical.nq.gz — normalized.nq.gz with blank nodes canonicalized using W3C RDF Dataset Canonicalization (RDFC-1.0), giving a stable, hashable, diff-friendly form. Committed via Git LFS.

Storage: always gzip, always LFS (IMPORTANT)

All N-Quads artifacts are gzipped (.nq.gz), never plain .nq (which is gitignored). N-Quads gzips ~16×. The CLI reads/writes gzip transparently.
third_party/skos/**/canonical.nq.gz is tracked by Git LFS (.gitattributes). After a fresh clone run git lfs pull or the files are just pointers (the smoke test npm test will flag this).
See CLAUDE.md for the full data-storage policy.

Commands

node scripts/skosdex fetch        <slug>   # download sourceURL -> cache/ (decompresses zip/gz)
node scripts/skosdex normalize    <slug>   # source -> normalized.nq.gz
node scripts/skosdex canonicalize <slug>   # normalized.nq.gz -> canonical.nq.gz
node scripts/skosdex build        [slug]   # all of the above, then bundle + solr-docs

Omit <slug> to act on every scheme. build skips data steps for metadata-only (non-open / bundle:false) schemes automatically.

Notes

Compressed sources: set skosdex:compression to zip or gzip in meta.ttl and fetch decompresses automatically (uses unzip for zip, needs it on PATH). skosdex:sourceEntry picks the member of a multi-file zip.
Supported source formats (parsed by n3): Turtle, N-Triples, N-Quads, TriG, N3. RDF/XML is not supported — convert upstream first (rapper/riot) or add a per-scheme helper in the scheme's tools/ folder.
Canonicalization fast-path: schemes with no blank nodes (most IRI-based SKOS, e.g. NALT, IPTC) skip RDFC-1.0 — the sorted normalized form already IS canonical. This turns a multi-minute pass into ~1s on large schemes.
cache/ is gitignored; never commit fetched third-party data unless it is openly licensed and intentionally tracked.
Re-running is idempotent: canonical output is deterministic, so canonical.nq.gz only changes when the source does.

More from this repository

same repository

embed-at-scale

danbri/skosdex

Use when (re)building skosdex concept embeddings for many or all schemes at once — a one-off GPU batch box to embed the whole corpus ASAP, or a parallel CI matrix for incremental per-scheme additions. Covers the embed pipeline, where to run it (and why not the prod box), model parity, committing + deploying the vectors with no blackout, and — critically — tearing the GPU box down afterwards so it stops billing.

2026-06-171

embeddings-api

danbri/skosdex

Use when working with skosdex concept embeddings — the per-scheme and combined vectors, their JSON formats, the in-browser "similar by meaning" / viz consumers, or the server-side similarity REST API (tools/embed_api.mjs). Covers how to build, combine, query, and extend them.

2026-06-171

deploy-fly

danbri/skosdex

Use when redeploying the live skosdex stack (skosdex.fly.dev — Oxigraph + Solr + web) on Fly.io, choosing between a direct deploy and the zero-downtime cutover, forcing/monitoring a deploy, or recovering a broken one. The deploy is CI-driven from claude/main.

2026-06-161

add-skos-scheme

danbri/skosdex

Use when adding a new SKOS concept scheme / vocabulary / thesaurus to the skosdex repository (creating its third_party/skos/<slug>/ folder and meta.ttl), or when deciding whether a scheme's data may be committed and bundled given its license.

2026-06-101

curate-vocabularies

danbri/skosdex

Use when discovering, researching, triaging, or maintaining the list of candidate SKOS vocabularies for skosdex — i.e. updating third_party/skos/CANDIDATES.md, verifying a scheme's license, or deciding whether a vocabulary can be bundled or must stay metadata-only.

2026-06-101

build-data-bundle

danbri/skosdex

Use when producing the shippable skosdex dataset — merging openly-licensed canonical N-Quads into dist/bundle.nq.gz, generating dist/solr-docs.json, building the docs/ site, or understanding which schemes are included/excluded and why.

2026-06-091

name	normalize-skos
description	Use when fetching, parsing, normalizing, or canonicalizing a SKOS scheme into N-Quads in skosdex — i.e. running the scripts/skosdex fetch/normalize/canonicalize pipeline or debugging its normalized.nq.gz / canonical.nq.gz output, including the gzip + Git LFS storage and zip/gz source decompression.
license	Apache-2.0

Normalize & canonicalize a scheme

scripts/skosdex (Node, ESM; deps: n3, rdf-canonize) turns each scheme's source RDF into two gzipped artifacts in its folder:

normalized.nq.gz — parsed, sorted, de-duplicated N-Quads (build artifact, gitignored).
canonical.nq.gz — normalized.nq.gz with blank nodes canonicalized using W3C RDF Dataset Canonicalization (RDFC-1.0), giving a stable, hashable, diff-friendly form. Committed via Git LFS.

Storage: always gzip, always LFS (IMPORTANT)

All N-Quads artifacts are gzipped (.nq.gz), never plain .nq (which is gitignored). N-Quads gzips ~16×. The CLI reads/writes gzip transparently.
third_party/skos/**/canonical.nq.gz is tracked by Git LFS (.gitattributes). After a fresh clone run git lfs pull or the files are just pointers (the smoke test npm test will flag this).
See CLAUDE.md for the full data-storage policy.

Commands

node scripts/skosdex fetch        <slug>   # download sourceURL -> cache/ (decompresses zip/gz)
node scripts/skosdex normalize    <slug>   # source -> normalized.nq.gz
node scripts/skosdex canonicalize <slug>   # normalized.nq.gz -> canonical.nq.gz
node scripts/skosdex build        [slug]   # all of the above, then bundle + solr-docs

Omit <slug> to act on every scheme. build skips data steps for metadata-only (non-open / bundle:false) schemes automatically.

Notes

Compressed sources: set skosdex:compression to zip or gzip in meta.ttl and fetch decompresses automatically (uses unzip for zip, needs it on PATH). skosdex:sourceEntry picks the member of a multi-file zip.
Supported source formats (parsed by n3): Turtle, N-Triples, N-Quads, TriG, N3. RDF/XML is not supported — convert upstream first (rapper/riot) or add a per-scheme helper in the scheme's tools/ folder.
Canonicalization fast-path: schemes with no blank nodes (most IRI-based SKOS, e.g. NALT, IPTC) skip RDFC-1.0 — the sorted normalized form already IS canonical. This turns a multi-minute pass into ~1s on large schemes.
cache/ is gitignored; never commit fetched third-party data unless it is openly licensed and intentionally tracked.
Re-running is idempotent: canonical output is deterministic, so canonical.nq.gz only changes when the source does.