METR/inspect_ai

記録された最新のソース活動: 2026年9月4日 15:54

SkillsMP カタログ更新: 2026年11月2日 18:02

収集済み skills: 3

GitHub スター: 11
GitHub フォーク: 3

AI アシスタントでインストール

このプロンプトをコピーして、使用中の AI アシスタントに送ってください。

Follow https://skillsmp.com/skill-install/prompt.md to install Agent Skills from https://github.com/METR/inspect_ai.

リポジトリの README

README の元ファイル：README.md

README の元ファイルを読む

README 全文を表示

[<img width="295" src="https://inspect.aisi.org.uk/images/aisi-logo.svg" />](https://aisi.gov.uk/) Welcome to Inspect, a framework for large language model evaluations created by the [UK AI Security Institute](https://aisi.gov.uk/). Inspect provides many built-in components, including facilities for prompt engineering, tool usage, multi-turn dialog, and model graded evaluations. Extensions to Inspect (e.g. to support new elicitation and scoring techniques) can be provided by other Python packages. To get started with Inspect, please see the documentation at <https://inspect.aisi.org.uk/>. Inspect also includes a collection of over 200 pre-built evaluations ready to run on any model (learn more at <https://inspect.aisi.org.uk/evals/>). > Coding agents: a structured index of the docs is published at <https://inspect.aisi.org.uk/llms.txt>. The user guide is concatenated as Markdown at <https://inspect.aisi.org.uk/llms-guide.txt>, and <https://inspect.aisi.org.uk/llms-full.txt> additionally bundles the API and CLI reference. Individual pages are available as Markdown by appending `.md` to the `.html` path (e.g. `/extensions/index.html.md`). *** To work on development of Inspect, clone the repository and install with the `-e` flag and `[dev]` optional dependencies: ```bash git clone https://github.com/UKGovernmentBEIS/inspect_ai.git cd inspect_ai pip install -e ".[dev]" ``` Alternatively, if you use [uv](https://docs.astral.sh/uv/), sync the development environment from the checked-in lockfile: ```bash uv sync --extra dev ``` The uv workflow is supported but not required. The `uv.lock` file records a reproducible development resolution; project dependencies are still declared in `requirements*.txt` and exposed through `pyproject.toml`. When changing dependencies, update the appropriate requirements file and refresh the lockfile rather than relying on `uv add`. Optionally install pre-commit hooks via ```bash make hooks ``` Run linting, formatting, and tests via ```bash make check make test ``` When working in a uv-managed environment, prefix those commands with `uv run` (for example, `uv run make check`). If you use VS Code, you should be sure to have installed the recommended extensions (Python, Ruff, and MyPy). Note that you'll be prompted to install these when you open the project in VS Code. ### Frontend development (TypeScript) The web UI lives in a git submodule at `src/inspect_ai/_view/ts-mono/`. **These steps are only needed if you plan to work on the TypeScript/React frontend** — Python-only contributors can skip this entirely. Initialize the submodule and install dependencies — see the [one-time setup guide](https://github.com/meridianlabs-ai/ts-mono/blob/main/docs/submodule-guide.md#one-time-setup). ### Documentation To work on the Inspect documentation, install the optional `[doc]` dependencies with the `-e` flag and build the docs: ``` pip install -e ".[doc]" cd docs quarto render # or 'quarto preview' ``` If you intend to work on the docs iteratively, you'll want to install the Quarto extension in VS Code.

リポジトリの README を読み込んでいます…

このリポジトリの skills

ネットワーク・コンピュータシステム管理者

1 件の職業カテゴリ · 33% 分類済み

skill

職業分類

説明

更新

slow-tests

未分類

Run the gated test classes that plain `pytest` skips (slow Docker/sandbox tests, live model-provider API tests, flaky tests, trio variants). Use when asked to run slow, live, api, or trio tests, when debugging one, or when a change touches model providers,…

原文の言語: 英語

2026-09-04

release-sandbox-tools

未分類

Land a PR that requires new inspect-sandbox-tools injectable binaries to be built and published. Use when asked to land/merge a PR that changed code under src/inspect_sandbox_tools/ (typically its slow-tool-tests-release check fails on missing published…

原文の言語: 英語

2026-08-21

ci-perf

ネットワーク・コンピュータシステム管理者

Assess and improve CI performance for pull requests in this repo. Use whenever the user asks about CI speed, slow CI, how long checks take, queue/runner wait, slow or duplicate tests, CI cost, or asks to run the recurring CI performance report (/ci-perf).…

原文の言語: 英語

2026-08-19

収集済み skill 3 件中 3 件を表示しています。