create-eval

Redirect to the inspect-evals-template for creating new evaluations. New evals are no longer created in this repository — they live in standalone repos. Use when user asks to create/implement/build a new evaluation.

Jump to install

Repository: UKGovernmentBEIS/inspect_evals
Last source activity: May 4, 2026 at 17:59
Detected SKILL.md language: English
Stars: 625
Forks: 400

Install options

The review-first prompt is selected by default. You can switch to a direct command or download a local copy.

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

A direct command skips the review prompt. Inspect the source before running it.

npx skills add https://github.com/UKGovernmentBEIS/inspect_evals --skill create-eval

The command stays on one line. Scroll horizontally to inspect it before copying.

Prefer a local copy? Download the files currently available to SkillsMP.

Review the source files

Read SKILL.md and any companion files shown by SkillsMP before deciding whether to install.

SKILL.md

Source instructions · Read-only preview

Back to search Back to installation

build-repo-context

Crawl repository PRs, issues, and review comments to distill institutional knowledge into a shared knowledge base. Run periodically by "context agents" to maintain agent_artefacts/repo_context/REPO_CONTEXT.md. Trigger only on specific request.

2026-07-02

check-trajectories-workflow

Use Inspect Scout to analyze agent trajectories from evaluation log files. Runs default and custom scanners to detect external failures, formatting issues, reward hacking, and ethical refusals. Use when user asks to check/analyze agent trajectories. Trigger when the user asks you to run the "Check Agent Trajectories" workflow.

2026-07-02

ci-maintenance-workflow

CI and GitHub Actions maintenance workflows — fix a failing test from a CI URL, fix a failing smoke test, add @pytest.mark.slow markers to slow tests, or review a PR against agent-checkable standards. Use when user asks to fix a failing test, fix a smoke test, mark slow tests, or review a PR. Trigger when the user asks you to run the "Write a PR For A Failing Test", "Fix A Failing Smoke Test", "Mark Slow Tests", or "Review PR According to Agent-Checkable Standards" workflow.

2026-07-02

View all from this repository

name	create-eval
description	Redirect to the inspect-evals-template for creating new evaluations. New evals are no longer created in this repository — they live in standalone repos. Use when user asks to create/implement/build a new evaluation.

Create Evaluation

New evaluations are no longer created in the inspect_evals repository. Since May 2026, evaluations live in their own standalone repositories. This repo now serves as a register that points to upstream eval repos.

This skill has been moved to inspect-evals-template: https://github.com/Generality-Labs/inspect-evals-template/tree/main/.claude/skills/create-eval. If a user triggers this skill, inform them to go to the template to run or access the skill there.

If a user asks to create an eval, inform them that Inspect Evals no longer accepts code submissions for new evals and suggest the inspect-evals-template for guidance on creating evals.

Quick reference

Step	Where
Create a new eval	inspect-evals-template
Register a completed eval	This repo — use the Prepare Evaluation For Submission skill

create-eval

Source facts

Install options

Review the source files

More from this repository

More from this repository

Create Evaluation

Quick reference

Create Evaluation

Quick reference