一键在 Manus 中运行任何 Skill

normalize-skos

星标1

分支0

更新时间2026年6月9日 12:28

Use when fetching, parsing, normalizing, or canonicalizing a SKOS scheme into N-Quads in skosdex — i.e. running the scripts/skosdex fetch/normalize/canonicalize pipeline or debugging its normalized.nq.gz / canonical.nq.gz output, including the gzip + Git LFS storage and zip/gz source decompression.

安装

用 Codex 或 Claude 帮你安装复制这段 Prompt，粘贴到 Codex、Claude 或其他助手里，让它检查 Skill 页面并帮你完成安装。

在 Manus 中运行

来源

danbri

danbri/skosdex

打开 GitHub 仓库查看创作者相关仓库

下载

在 Manus 中运行

Normalize & canonicalize a scheme

scripts/skosdex (Node, ESM; deps: n3, rdf-canonize) turns each scheme's source RDF into two gzipped artifacts in its folder:

normalized.nq.gz — parsed, sorted, de-duplicated N-Quads (build artifact, gitignored).
canonical.nq.gz — normalized.nq.gz with blank nodes canonicalized using W3C RDF Dataset Canonicalization (RDFC-1.0), giving a stable, hashable, diff-friendly form. Committed via Git LFS.

Storage: always gzip, always LFS (IMPORTANT)

All N-Quads artifacts are gzipped (.nq.gz), never plain .nq (which is gitignored). N-Quads gzips ~16×. The CLI reads/writes gzip transparently.
third_party/skos/**/canonical.nq.gz is tracked by Git LFS (.gitattributes). After a fresh clone run git lfs pull or the files are just pointers (the smoke test npm test will flag this).
See CLAUDE.md for the full data-storage policy.

Commands

node scripts/skosdex fetch        <slug>   # download sourceURL -> cache/ (decompresses zip/gz)
node scripts/skosdex normalize    <slug>   # source -> normalized.nq.gz
node scripts/skosdex canonicalize <slug>   # normalized.nq.gz -> canonical.nq.gz
node scripts/skosdex build        [slug]   # all of the above, then bundle + solr-docs

Omit <slug> to act on every scheme. build skips data steps for metadata-only (non-open / bundle:false) schemes automatically.

Notes

Compressed sources: set skosdex:compression to zip or gzip in meta.ttl and fetch decompresses automatically (uses unzip for zip, needs it on PATH). skosdex:sourceEntry picks the member of a multi-file zip.
Supported source formats (parsed by n3): Turtle, N-Triples, N-Quads, TriG, N3. RDF/XML is not supported — convert upstream first (rapper/riot) or add a per-scheme helper in the scheme's tools/ folder.
Canonicalization fast-path: schemes with no blank nodes (most IRI-based SKOS, e.g. NALT, IPTC) skip RDFC-1.0 — the sorted normalized form already IS canonical. This turns a multi-minute pass into ~1s on large schemes.
cache/ is gitignored; never commit fetched third-party data unless it is openly licensed and intentionally tracked.
Re-running is idempotent: canonical output is deterministic, so canonical.nq.gz only changes when the source does.

同仓库更多 Skills

同仓库

embed-at-scale

danbri/skosdex

Use when (re)building skosdex concept embeddings for many or all schemes at once — a one-off GPU batch box to embed the whole corpus ASAP, or a parallel CI matrix for incremental per-scheme additions. Covers the embed pipeline, where to run it (and why not the prod box), model parity, committing + deploying the vectors with no blackout, and — critically — tearing the GPU box down afterwards so it stops billing.

2026-06-171

embeddings-api

danbri/skosdex

Use when working with skosdex concept embeddings — the per-scheme and combined vectors, their JSON formats, the in-browser "similar by meaning" / viz consumers, or the server-side similarity REST API (tools/embed_api.mjs). Covers how to build, combine, query, and extend them.

2026-06-171

deploy-fly

danbri/skosdex

Use when redeploying the live skosdex stack (skosdex.fly.dev — Oxigraph + Solr + web) on Fly.io, choosing between a direct deploy and the zero-downtime cutover, forcing/monitoring a deploy, or recovering a broken one. The deploy is CI-driven from claude/main.

2026-06-161

add-skos-scheme

danbri/skosdex

Use when adding a new SKOS concept scheme / vocabulary / thesaurus to the skosdex repository (creating its third_party/skos/<slug>/ folder and meta.ttl), or when deciding whether a scheme's data may be committed and bundled given its license.

2026-06-101

curate-vocabularies

danbri/skosdex

Use when discovering, researching, triaging, or maintaining the list of candidate SKOS vocabularies for skosdex — i.e. updating third_party/skos/CANDIDATES.md, verifying a scheme's license, or deciding whether a vocabulary can be bundled or must stay metadata-only.

2026-06-101

build-data-bundle

danbri/skosdex

Use when producing the shippable skosdex dataset — merging openly-licensed canonical N-Quads into dist/bundle.nq.gz, generating dist/solr-docs.json, building the docs/ site, or understanding which schemes are included/excluded and why.

2026-06-091

name	normalize-skos
description	Use when fetching, parsing, normalizing, or canonicalizing a SKOS scheme into N-Quads in skosdex — i.e. running the scripts/skosdex fetch/normalize/canonicalize pipeline or debugging its normalized.nq.gz / canonical.nq.gz output, including the gzip + Git LFS storage and zip/gz source decompression.
license	Apache-2.0

Normalize & canonicalize a scheme

scripts/skosdex (Node, ESM; deps: n3, rdf-canonize) turns each scheme's source RDF into two gzipped artifacts in its folder:

normalized.nq.gz — parsed, sorted, de-duplicated N-Quads (build artifact, gitignored).
canonical.nq.gz — normalized.nq.gz with blank nodes canonicalized using W3C RDF Dataset Canonicalization (RDFC-1.0), giving a stable, hashable, diff-friendly form. Committed via Git LFS.

Storage: always gzip, always LFS (IMPORTANT)

All N-Quads artifacts are gzipped (.nq.gz), never plain .nq (which is gitignored). N-Quads gzips ~16×. The CLI reads/writes gzip transparently.
third_party/skos/**/canonical.nq.gz is tracked by Git LFS (.gitattributes). After a fresh clone run git lfs pull or the files are just pointers (the smoke test npm test will flag this).
See CLAUDE.md for the full data-storage policy.

Commands

node scripts/skosdex fetch        <slug>   # download sourceURL -> cache/ (decompresses zip/gz)
node scripts/skosdex normalize    <slug>   # source -> normalized.nq.gz
node scripts/skosdex canonicalize <slug>   # normalized.nq.gz -> canonical.nq.gz
node scripts/skosdex build        [slug]   # all of the above, then bundle + solr-docs

Omit <slug> to act on every scheme. build skips data steps for metadata-only (non-open / bundle:false) schemes automatically.

Notes

Compressed sources: set skosdex:compression to zip or gzip in meta.ttl and fetch decompresses automatically (uses unzip for zip, needs it on PATH). skosdex:sourceEntry picks the member of a multi-file zip.
Supported source formats (parsed by n3): Turtle, N-Triples, N-Quads, TriG, N3. RDF/XML is not supported — convert upstream first (rapper/riot) or add a per-scheme helper in the scheme's tools/ folder.
Canonicalization fast-path: schemes with no blank nodes (most IRI-based SKOS, e.g. NALT, IPTC) skip RDFC-1.0 — the sorted normalized form already IS canonical. This turns a multi-minute pass into ~1s on large schemes.
cache/ is gitignored; never commit fetched third-party data unless it is openly licensed and intentionally tracked.
Re-running is idempotent: canonical output is deterministic, so canonical.nq.gz only changes when the source does.