Run any Skill in Manus with one click

sync-metadata

Stars29

Forks5

UpdatedMarch 17, 2026 at 01:39

Reconcile task metadata between selected_benchmark_tasks.json and task.toml files. Finds and fixes drift. Triggers on sync metadata, check metadata, metadata mismatch, reconcile tasks.

Installation

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

Run Skill in Manus

Source

sourcegraph

sourcegraph/CodeScaleBench

View GitHub Repository View Creator Repositories

Download

Run Skill in Manus

Related occupationsSOC

Based on SOC occupation classification

Software Quality Assurance Analysts and TestersComputer and Mathematical Occupations·SOC 15-1253

SKILL.md

readonly

name	sync-metadata
description	Reconcile task metadata between selected_benchmark_tasks.json and task.toml files. Finds and fixes drift. Triggers on sync metadata, check metadata, metadata mismatch, reconcile tasks.
user-invocable	true

Sync Metadata

Ensure task.toml files match the authoritative selected_benchmark_tasks.json registry.

What It Catches

Language mismatches (task.toml says "python" but selection says "go")
Difficulty label drift (task.toml says "medium" but selection says "hard")
Missing task.toml files for selected tasks

Steps

1. Run the sync check

cd ~/CodeScaleBench && python3 scripts/sync_task_metadata.py

2. Present mismatches

Show any fields where task.toml disagrees with selected_benchmark_tasks.json.

3. Offer to fix

If mismatches found:

python3 scripts/sync_task_metadata.py --fix

This updates the task.toml files to match the selection registry.

Variants

Filter to one suite

python3 scripts/sync_task_metadata.py --suite csb_sdlc_pytorch

JSON output

python3 scripts/sync_task_metadata.py --format json

More from this repository

same repository

archive-run

sourcegraph/CodeScaleBench

Archive old completed benchmark runs to save disk space and speed up scans. Triggers on archive runs, clean up runs, disk space, old runs.

2026-03-1729

benchmark-audit

sourcegraph/CodeScaleBench

Audit benchmark suites against ABC framework (Task/Outcome/Reporting validity). Checks instruction quality, verifier correctness, reproducibility. Triggers on benchmark audit, audit benchmark, abc audit, task validity.

2026-03-1729

check-infra

sourcegraph/CodeScaleBench

Verify infrastructure readiness before launching benchmark runs — tokens, Docker, disk, credentials. Triggers on check infra, infrastructure check, ready to run, pre-run check.

2026-03-1729

compare-configs

sourcegraph/CodeScaleBench

Compare benchmark results across agent configurations (baseline, SG_full). Show where configs diverge. Triggers on compare configs, config comparison, which config wins, MCP impact.

2026-03-1729

cost-report

sourcegraph/CodeScaleBench

Token and cost analysis per run, suite, and config. Shows most expensive tasks and config cost comparison. Triggers on cost report, how much did it cost, token usage, spending.

2026-03-1729

generate-report

sourcegraph/CodeScaleBench

Generate the aggregate CSB evaluation report from completed Harbor runs. Triggers on generate report, eval report, ccb report, benchmark report.

2026-03-1729

name	sync-metadata
description	Reconcile task metadata between selected_benchmark_tasks.json and task.toml files. Finds and fixes drift. Triggers on sync metadata, check metadata, metadata mismatch, reconcile tasks.
user-invocable	true

Sync Metadata

Ensure task.toml files match the authoritative selected_benchmark_tasks.json registry.

What It Catches

Language mismatches (task.toml says "python" but selection says "go")
Difficulty label drift (task.toml says "medium" but selection says "hard")
Missing task.toml files for selected tasks

Steps

1. Run the sync check

cd ~/CodeScaleBench && python3 scripts/sync_task_metadata.py

2. Present mismatches

Show any fields where task.toml disagrees with selected_benchmark_tasks.json.

3. Offer to fix

If mismatches found:

python3 scripts/sync_task_metadata.py --fix

This updates the task.toml files to match the selection registry.

Variants

Filter to one suite

python3 scripts/sync_task_metadata.py --suite csb_sdlc_pytorch

JSON output

python3 scripts/sync_task_metadata.py --format json