eval

Estrelas2

Forks0

Atualizado8 de julho de 2026 às 08:32

Use when measuring or tuning RagKit retrieval accuracy — runs the golden evalset, reports recall@k and MRR per bucket. Trigger /ragkit:eval. Run before or after any retrieval-param change to keep a baseline.

Instalação

Instalar com Codex ou Claude Copie este prompt, cole no Codex, Claude ou outro assistente e deixe que ele revise a página da skill e instale para você.

Executar no Manus

Fonte

qxbyte

qxbyte/pluginhub

Abrir repositório GitHub Ver repositórios do creator

Download

Executar no Manus

Ocupações relacionadasSOC

Baseado na classificação ocupacional SOC

Desenvolvedores de softwareInformática e Matemática·SOC 15-1252

SKILL.md

readonly

name	eval
description	Use when measuring or tuning RagKit retrieval accuracy — runs the golden evalset, reports recall@k and MRR per bucket. Trigger /ragkit:eval. Run before or after any retrieval-param change to keep a baseline.

RagKit Eval

脚本在本插件的 scripts/ 目录（本 skill 目录的上两级）；用本 skill 的 base directory 把下面的相对路径拼成绝对路径执行。

sh ../../scripts/run.sh ../../scripts/ragkit.py \
   eval --kb <知识库路径> [--evalset <file>] [--channels lexical,metadata]

--channels lexical,metadata = 无向量基线；与全通道对比即向量路增益。
任何检索参数调优（分词/权重/RRF）都必须先跑 eval 留对照数字。

Mais deste repositório

mesmo repositório

execute

qxbyte/pluginhub

Use when running a spec's execution tail — presents the 执行方式 selector, dispatches the chosen engine (task-swarm / superpowers / specode-native TDD), then runs acceptance and the distill prompt. Trigger /specode:execute <slug> manually at any time once tasks.md exists, or invoked by name (specode:execute) via the Skill tool by the spec / continue skills.

2026-07-092

intake

qxbyte/pluginhub

Use when running specode's requirements phase — project analysis + code location + clarification, then writing requirements.md. Produces <specsRoot>/<slug>/requirements.md (with the project_root frontmatter contract) plus the location pointers handed to the design phase. Invoked by name (specode:intake) via the Skill tool by the specode orchestration SKILL; not a user-triggered command.

2026-07-092

spec

qxbyte/pluginhub

Use when creating a new spec-driven workflow — the /specode:spec entry that walks requirements → design → tasks → 执行方式 → execute → acceptance, autonomously calling superpowers skills for the heavy lifting with a first-class specode-native fallback, and filing 4 fixed artifacts (requirements.md / design.md / tasks.md / implementation-log.md) under the user document directory. Trigger /specode:spec <request>, or 进入 spec 模式 with a new requirement.

2026-07-092

continue

qxbyte/pluginhub

Use when resuming an existing spec by slug — the /specode:continue entry that reads the fixed docs, reports a progress brief (inferred phase + checkbox progress), then stops and waits for the user; it never auto-resumes. Trigger /specode:continue <slug>.

2026-07-092

distill

qxbyte/pluginhub

Use when distilling a finished specode spec into atomic, locate-oriented markdown knowledge points — writes cases/ + navigation/ + MEMORY.md into the project's own <project_root>/knowledge-base/ (md-only, no auto-injection), optionally copied to an Obsidian vault. Trigger ONLY /specode:distill <slug>, never auto-run by the main specode flow.

2026-07-092

list

qxbyte/pluginhub

Use when listing all specs under the specs root — the /specode:list entry that shows every spec slug with its inferred phase, for looking up slugs or an overview; it does not resume. Trigger /specode:list.

2026-07-092

Execute qualquer Skill com um clique