How to write, run and debug evals with reeval, the eval runner for coding agents (npm package reeval; CLI `reeval`, alias `re`). Use whenever a task mentions reeval, reeval.config.ts, *.eval.ts files, `reeval run`, evals for a coding agent, comparing skills,…
reeval-ai/reeval
- Latest recorded source activity
- SkillsMP catalog refreshed
- skills collected
- 46
- GitHub stars
- 13
- GitHub forks
- 0
Install with an AI assistant
Copy this prompt into the AI assistant you're using.
Follow https://skillsmp.com/skill-install/prompt.md to install Agent Skills from https://github.com/reeval-ai/reeval.Loading the repository README…
Skills in this repository
Showing 40 of 46 collected skills.
End-to-end recipe for adding a new agent harness (a CLI reeval drives in the sandbox) to reeval: the catalog entry, the adapter package, the image and pin, the contract row, the telemetry declarations, replay captures and the generated harness matrix, plus…
How to bump a harness's pinned agent CLI or AI SDK adapter in reeval: the drift scripts, the Claude Code pnpm patch and its hash in the image tag, refreshing replay captures and formats, the real contract rows and the telemetry declarations. Use when…
Read this first, before the reeval skill, whenever you're asked to set up, install, add, try or get started with reeval (the eval runner for coding agents), in a project or an empty directory, including "set up reeval here" and "add evals". It detects what's…
How to greet.
Source text: Undetermined
Use when formatting.
Use when answering from the guide.
The ground-truth method for checking what reeval records about a harness against what actually happened: run a real attempt, collect the gateway traffic, the CLI's on-disk state and its native stream, diff all three against the run record and transcript…
Runs the installed contract probe. Use when asked to use the contract-installed skill.
The rubric reeval holds evals to, one section per remark kind. Load it when writing or reviewing a reeval eval's name, prompts, judge questions or compare, or when a reeval run prints a Remarks block.
How this project documents its functions. Use whenever you add or change an exported function.
How to add a new eval language runtime to reeval (Dart, Go, and so on): LanguageAdapter, stdio transport, attempt protocol v2, conformance goldens and a feature smoke fixture. Use when extending reeval beyond TypeScript *.eval.ts or wiring another…
Acme's design guidelines for web pages. Use when building or styling any Acme page.
The organization's greeting style. Use when writing greetings.
The organization's greeting style. Use when writing greetings.
The organization's greeting style. Use when writing greetings.
The organization's greeting style. Use when writing greetings.
The organization's farewell style. Use when signing off.
The organization's greeting style. Use when writing greetings.
The organization's greeting style. Use when writing greetings.
Source text: Undetermined
The house style for greetings in this organization. Use when writing any greeting function, message or text.
Greet people in the house style.
Ledger's brand. Use when adding or styling buttons, links or headings in the Ledger site.
How this project tests its code. Use whenever you add or change a function in src/.
How this project's functions reject bad arguments. Use whenever you write a function that can be called with an argument it can't handle.
Where things are in this package and how to check a change. Use before you add or change any code here.
How to prepare a release of this project. Use when asked to release, or to bump the version.
How this project records changes. Use whenever you add, change or remove code.
How this project documents its functions. Use whenever you add or change an exported function.
How this project documents its code. Use whenever you add or change an exported function.
The house style. Use when writing code here.
The house style. Use when writing code here.
Runs the plugin probe. Use when asked to use the plugin-probe skill or to run the plugin probe.
Greets the user with the line the plugin's build wrote.
Greets.
Source text: Undetermined
Lints a change the house way before review.
Tidies imports.
Source text: Undetermined
Lints a change the house way.
The project's own lint skill.
Source text: Undetermined
Use when writing greetings or user-facing messages in this codebase.