Exécutez n'importe quel Skill dans Manus
en un clic

Exécutez n'importe quel Skill dans Manus en un clic

sync-metadata

Étoiles29

Forks5

Mis à jour17 mars 2026 à 01:39

Reconcile task metadata between selected_benchmark_tasks.json and task.toml files. Finds and fixes drift. Triggers on sync metadata, check metadata, metadata mismatch, reconcile tasks.

Installation

Installer avec Codex ou Claude Copiez ce prompt, collez-le dans Codex, Claude ou un autre assistant, puis laissez-le vérifier la page du skill et l'installer pour vous.

Exécuter dans Manus

Source

sourcegraph

sourcegraph/CodeScaleBench

Ouvrir le dépôt GitHub Voir les dépôts du créateur

Téléchargement

Exécuter dans Manus

Métiers associésSOC

Basé sur la classification professionnelle SOC

Analystes en assurance qualité des logiciels et testeursProfessions informatiques et mathématiques·SOC 15-1253

SKILL.md

readonly

name	sync-metadata
description	Reconcile task metadata between selected_benchmark_tasks.json and task.toml files. Finds and fixes drift. Triggers on sync metadata, check metadata, metadata mismatch, reconcile tasks.
user-invocable	true

Sync Metadata

Ensure task.toml files match the authoritative selected_benchmark_tasks.json registry.

What It Catches

Language mismatches (task.toml says "python" but selection says "go")
Difficulty label drift (task.toml says "medium" but selection says "hard")
Missing task.toml files for selected tasks

Steps

1. Run the sync check

cd ~/CodeScaleBench && python3 scripts/sync_task_metadata.py

2. Present mismatches

Show any fields where task.toml disagrees with selected_benchmark_tasks.json.

3. Offer to fix

If mismatches found:

python3 scripts/sync_task_metadata.py --fix

This updates the task.toml files to match the selection registry.

Variants

Filter to one suite

python3 scripts/sync_task_metadata.py --suite csb_sdlc_pytorch

JSON output

python3 scripts/sync_task_metadata.py --format json

Plus depuis ce dépôt

même dépôt

archive-run

sourcegraph/CodeScaleBench

Archive old completed benchmark runs to save disk space and speed up scans. Triggers on archive runs, clean up runs, disk space, old runs.

2026-03-1729

benchmark-audit

sourcegraph/CodeScaleBench

Audit benchmark suites against ABC framework (Task/Outcome/Reporting validity). Checks instruction quality, verifier correctness, reproducibility. Triggers on benchmark audit, audit benchmark, abc audit, task validity.

2026-03-1729

check-infra

sourcegraph/CodeScaleBench

Verify infrastructure readiness before launching benchmark runs — tokens, Docker, disk, credentials. Triggers on check infra, infrastructure check, ready to run, pre-run check.

2026-03-1729

compare-configs

sourcegraph/CodeScaleBench

Compare benchmark results across agent configurations (baseline, SG_full). Show where configs diverge. Triggers on compare configs, config comparison, which config wins, MCP impact.

2026-03-1729

cost-report

sourcegraph/CodeScaleBench

Token and cost analysis per run, suite, and config. Shows most expensive tasks and config cost comparison. Triggers on cost report, how much did it cost, token usage, spending.

2026-03-1729

generate-report

sourcegraph/CodeScaleBench

Generate the aggregate CSB evaluation report from completed Harbor runs. Triggers on generate report, eval report, ccb report, benchmark report.

2026-03-1729

name	sync-metadata
description	Reconcile task metadata between selected_benchmark_tasks.json and task.toml files. Finds and fixes drift. Triggers on sync metadata, check metadata, metadata mismatch, reconcile tasks.
user-invocable	true

Sync Metadata

Ensure task.toml files match the authoritative selected_benchmark_tasks.json registry.

What It Catches

Language mismatches (task.toml says "python" but selection says "go")
Difficulty label drift (task.toml says "medium" but selection says "hard")
Missing task.toml files for selected tasks

Steps

1. Run the sync check

cd ~/CodeScaleBench && python3 scripts/sync_task_metadata.py

2. Present mismatches

Show any fields where task.toml disagrees with selected_benchmark_tasks.json.

3. Offer to fix

If mismatches found:

python3 scripts/sync_task_metadata.py --fix

This updates the task.toml files to match the selection registry.

Variants

Filter to one suite

python3 scripts/sync_task_metadata.py --suite csb_sdlc_pytorch

JSON output

python3 scripts/sync_task_metadata.py --format json