| name | publish |
| description | Publish a Harbor task or dataset to the registry. Use when the user wants to upload, publish, or share tasks or datasets/benchmarks on the Harbor registry. |
Help the user publish a Harbor task or dataset to the registry. Walk them through each step, checking prerequisites and confirming before running publish commands.
All commands use uvx harbor so the user does not need to install the CLI globally.
Prerequisites
-
Auth: Ensure the user is logged in by running uvx harbor auth status. If not logged in, prompt them to run uvx harbor auth login.
-
Task identifiers: All tasks must have a [task] section in their task.toml with a name like <org>/<name>. If missing, run:
uvx harbor task update "<path/to/task>" --org "<org>"
To update all tasks in a directory:
uvx harbor task update "<path/to/tasks>" --org "<org>" --scan
Publishing a task
uvx harbor publish "<path/to/task>"
Publish multiple tasks or all tasks in a directory:
uvx harbor publish "<path/to/task-a>" "<path/to/task-b>"
uvx harbor publish "<path/to/tasks>"
Publishing a dataset
1. Initialize the dataset manifest (if no dataset.toml exists)
uvx harbor dataset init "<org>/<dataset>" \
--description "<description>" \
--author "Jane Doe <jane@example.com>"
Add --with-metric if the user needs a custom metric script. If omitted, the dataset uses the default metric (average reward across tasks, with missing values treated as 0).
Auto-add behavior: If dataset init is run in a directory that already contains tasks, those tasks are automatically added to the manifest. After init, ask the user if they want to add additional tasks — either from the Harbor registry or from other local folders.
2. Add additional tasks and files (optional)
cd "<path/to/dataset>"
uvx harbor add "<path/to/task-a>" "<path/to/task-b>"
uvx harbor add "<path/to/folder>" --scan
uvx harbor add org/task-name
uvx harbor add org/dataset-name
uvx harbor add metric.py
uvx harbor remove "<org>/<task-name>"
Specific versions: org/task@tag, org/task@revision, or org/task@sha256:<hash>.
3. Sync digests (if tasks/metrics changed since last publish)
uvx harbor sync
uvx harbor sync --upgrade
4. Publish the dataset
uvx harbor publish "<path/to/dataset>"
uvx harbor publish automatically refreshes digests of local tasks in the dataset directory.
Publish options (tasks and datasets)
-t / --tag: add tags (repeatable). latest is always included.-c / --concurrency: control upload concurrency.--public: make public (private by default).--no-tasks (datasets only): skip publishing tasks in the dataset directory.
Example:
uvx harbor publish "<path>" -t v1.0 --public
After publishing
