headless-adapters

Discover, create, and validate headless adapters for agent integration. Includes scaffolding tools and schema-driven compliance testing.

Jump to install

Repository: youdotcom-oss/web-search-agent-evals
Last source activity: February 10, 2026 at 18:29
Detected SKILL.md language: English
Stars: 5
Forks: 0

Install options

The review-first prompt is selected by default. You can switch to a direct command or download a local copy.

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

A direct command skips the review prompt. Inspect the source before running it.

npx skills add https://github.com/youdotcom-oss/web-search-agent-evals --skill headless-adapters

The command stays on one line. Scroll horizontally to inspect it before copying.

Prefer a local copy? Download the files currently available to SkillsMP.

Review the source files

Read SKILL.md and any companion files shown by SkillsMP before deciding whether to install.

File Explorer

5 files

SKILL.md

Source instructions · Read-only preview

Back to search Back to installation

web-search-agent-evals

Development assistant for web search agent evaluations across multiple CLI agents

2026-02-19

agent-eval-harness

CLI tool for capturing agent trajectories. Execute prompts against headless CLI agents via schema-driven adapters, capture full trajectories (tools, thoughts, plans), and output structured JSONL for downstream scoring.

2026-02-10

code-documentation

TSDoc standards for TypeScript/JavaScript code. Automatically invoked when writing, reviewing, or editing any TSDoc comments, code documentation, or API documentation. (project)

2026-02-10

View all from this repository

{
  "version": 1,
  "name": "my-agent",
  "command": ["my-agent-cli"],
  "sessionMode": "stream",
  "prompt": { "flag": "-p" },
  "output": { "flag": "--output-format", "value": "stream-json" },
  "autoApprove": ["--allow-all"],
  "outputEvents": [
    {
      "match": { "path": "$.type", "value": "message" },
      "emitAs": "message",
      "extract": { "content": "$.text" }
    }
  ],
  "result": {
    "matchPath": "$.type",
    "matchValue": "result",
    "contentPath": "$.content"
  }
}

# Claude Code
ANTHROPIC_API_KEY=... bunx @plaited/agent-eval-harness headless --schema .claude/skills/headless-adapters/schemas/claude-headless.json

# Gemini CLI
GEMINI_API_KEY=... bunx @plaited/agent-eval-harness headless --schema .claude/skills/headless-adapters/schemas/gemini-headless.json

Issue	Likely Cause	Solution
Tool calls not captured	JSONPath not iterating arrays	Use `[*]` wildcard syntax - see guide
"unexpected argument" error	Stdin mode misconfigured	Use `stdin: true` - see guide
401 Authentication errors	API key not properly configured	Set the correct API key environment variable (see Pre-built Schemas table)
Timeout on prompt	JSONPath not matching	Capture raw CLI output, verify paths - see guide
Empty responses	Content extraction failing	Check extract paths - see guide

Use Case	Tool
Wrap headless CLI agent	`headless` command
Create new schemas	Schema Creation Guide

Use Case	Tool
Wrap headless CLI agent	`headless` command
Create new schemas	Schema Creation Guide

Mode	Description	Use When
`stream`	Keep process alive, multi-turn via stdin	CLI supports session resume
`iterative`	New process per turn, accumulate history	CLI is stateless

Schema	Agent	Mode	Auth Env Var	Status
`claude-headless.json`	Claude Code	stream	`ANTHROPIC_API_KEY`	Tested
`gemini-headless.json`	Gemini CLI	iterative	`GEMINI_API_KEY`	Tested

headless-adapters

Install options

Review the source files