publish-dataset

Publish an eval dataset to Hugging Face Hub (or GitHub as a fallback). Use when the user wants to share the inputs/labels used by an eval — with a dataset card, licensing, splits, and a content hash so downstream runs can verify integrity.

Ir para a instalação

Repositório: danielrosehill/Claude-Eval-Runner-Plugin
Última atividade na origem: 24 de abril de 2026 às 17:18
Idioma detectado do SKILL.md: inglês
Estrelas: 0
Forks: 0

Opções de instalação

Por padrão, está selecionado o prompt que primeiro revisa a origem. Você pode mudar para um comando direto ou baixar uma cópia local.

Instalar com Codex ou Claude Copie este prompt, cole no Codex, Claude ou outro assistente e deixe que ele revise a página da skill e instale para você.

Um comando direto ignora o prompt de revisão. Verifique a origem antes de executá-lo.

npx skills add https://github.com/danielrosehill/Claude-Eval-Runner-Plugin --skill publish-dataset

O comando permanece em uma só linha. Role horizontalmente para revisá-lo antes de copiar.

Prefere uma cópia local? Baixe os arquivos disponíveis atualmente no SkillsMP.

Revise os arquivos de origem

Leia o SKILL.md e os arquivos complementares exibidos pelo SkillsMP antes de decidir se vai instalar.

SKILL.md

Instruções da origem · Visualização somente leitura

Voltar à pesquisa Voltar à instalação

create-eval

Design a custom eval from scratch, or remix an existing benchmark. Use when the user wants to define the eval itself — task framing, dataset composition, scoring rubric, and reporting format — rather than simply wiring up a framework. Produces a fully specified eval definition ready to be run.

2026-04-24

new-workspace

Provision a new eval-runner workspace on disk. Use when the user wants to start a new evaluation project — scaffolds evals/, datasets/, results/, and docs/ directories, personalises CLAUDE.md, and (by default) creates a GitHub repo.

2026-04-24

publish-eval

Publish an eval (definition + results) so others can reproduce it. Use when the user wants to share an eval publicly — as a GitHub repo, Hugging Face space, or a standalone writeup. Produces a clean, self-contained bundle with README, task spec, rubric, dataset pointer, and a run report.

2026-04-24

Ver todas deste repositório

Publish a Dataset

Packages a dataset from datasets/<id>/ and pushes it to the Hub.

Arguments

Dataset id (required) — must match a directory under datasets/.

--target=<hf|github> — default hf.

--private — private dataset repo.

--license=<spdx> — default cc-by-4.0 (ask user if unclear).

Procedure

Pre-flight.

datasets/<id>/ exists with at least a data/ folder and a CARD.md draft. If no CARD.md, stub one and ask the user to fill load-bearing sections before publish.
Scan for PII / secrets / copyrighted blobs. Stop and flag anything suspicious.
Confirm splits — train/validation/test or the user's custom split.

Normalise format. Prefer Parquet or JSONL with a consistent schema. Generate a schema.json. If source is CSV, convert. If source is images/audio, ensure a manifest file exists.

Hash. Compute a content hash (sha256 over sorted file hashes) and record it in datasets/<id>/HASH. This is what run-eval verifies.

Dataset card. Finish CARD.md with the HF standard sections: dataset summary, supported tasks, languages, dataset structure, data fields, data splits, source data, annotations, considerations for using the data, licensing, citation. Draft missing sections with TODO markers — don't fabricate.

Push.

hf: huggingface-cli repo create (dataset type), huggingface-cli upload. User defaults: the HF user is danielrosehill unless stated otherwise — confirm if ambiguous.
github: create a repo, use Git LFS for anything > 50MB, push.

Cross-link. Update the relevant eval's DATASET.md to point at the published URL and record the hash. If an eval config references the dataset, update it to pull from the Hub.

Record publication. Append to docs/publications.md.

Report. URL, hash, size, splits, license.

Publish a Dataset

Packages a dataset from datasets/<id>/ and pushes it to the Hub.

Arguments

Dataset id (required) — must match a directory under datasets/.

--target=<hf|github> — default hf.

--private — private dataset repo.

--license=<spdx> — default cc-by-4.0 (ask user if unclear).

Procedure

Pre-flight.

datasets/<id>/ exists with at least a data/ folder and a CARD.md draft. If no CARD.md, stub one and ask the user to fill load-bearing sections before publish.
Scan for PII / secrets / copyrighted blobs. Stop and flag anything suspicious.
Confirm splits — train/validation/test or the user's custom split.

Normalise format. Prefer Parquet or JSONL with a consistent schema. Generate a schema.json. If source is CSV, convert. If source is images/audio, ensure a manifest file exists.

Hash. Compute a content hash (sha256 over sorted file hashes) and record it in datasets/<id>/HASH. This is what run-eval verifies.

Push.

hf: huggingface-cli repo create (dataset type), huggingface-cli upload. User defaults: the HF user is danielrosehill unless stated otherwise — confirm if ambiguous.
github: create a repo, use Git LFS for anything > 50MB, push.

Cross-link. Update the relevant eval's DATASET.md to point at the published URL and record the hash. If an eval config references the dataset, update it to pull from the Hub.

Record publication. Append to docs/publications.md.

Report. URL, hash, size, splits, license.

name	publish-dataset
description	Publish an eval dataset to Hugging Face Hub (or GitHub as a fallback). Use when the user wants to share the inputs/labels used by an eval — with a dataset card, licensing, splits, and a content hash so downstream runs can verify integrity.

publish-dataset

Informações da origem

Opções de instalação

Revise os arquivos de origem

Mais deste repositório

Mais deste repositório

Publish a Dataset

Arguments

Procedure

Publish a Dataset

Arguments

Procedure