harbor-framework/harbor

rewardkit

Write Harbor task verifiers using Reward Kit. Use when creating or editing a task's tests/ directory, adding grading criteria, setting up LLM/agent judges, or designing verifiers that produce a reward score.

Quellsprache: Englisch

create-task

Create a new Harbor task for evaluating agents. Use when the user wants to scaffold, build, or design a new task, benchmark problem, or eval. Guides through instruction writing, environment setup, verifier design (pytest vs Reward Kit vs custom), and solution…

Quellsprache: Englisch

publish

Publish a Harbor task or dataset to the registry. Use when the user wants to upload, publish, or share tasks or datasets/benchmarks on the Harbor registry.

Quellsprache: Englisch

create-adapter

Scaffold a new Harbor benchmark adapter by running `harbor adapter init` and then guide implementation using the Adapters Agent Guide as the authoritative spec.

Quellsprache: Englisch

harbor-exec

Use when working with Harbor's `harbor exec` CLI workflow: compiling files, directories, or globs into Harbor tasks; running map jobs; configuring artifacts and existence-only verification; using map-reduce; writing or reviewing ExecConfig YAML/JSON/TOML; or…

Quellsprache: Englisch

bundled-keep

Existing task skill that should remain after job-level skill injection.

Quellsprache: Englisch

runtime-proof

Write the proof file for the Harbor runtime skill injection example.

Quellsprache: Englisch

upload-parity-experiments

Create or reuse Hugging Face dataset PRs for `harborframework/parity-experiments` and upload Harbor parity/oracle result folders efficiently with sparse checkout, raw git pushes, and Git LFS.

Quellsprache: Englisch

generate-greeting

Generate a greeting message and write it to a file.

Quellsprache: Englisch