Jeden Skill in Manus ausführen
mit einem Klick

Jeden Skill in Manus mit einem Klick ausführen

evaluations

Sterne3.411

Forks337

Aktualisiert20. Juli 2026 um 23:13

Compatibility router for LangWatch evaluation requests. Use only when the user asks for evaluations without making it clear whether they mean pre-deployment experiments or production online evaluations. Routes the request to the focused companion skill and does not implement either workflow itself.

Installation

Mit Codex oder Claude installieren Kopieren Sie diesen Prompt, fügen Sie ihn in Codex, Claude oder einen anderen Assistant ein und lassen Sie die Skill-Seite prüfen und installieren.

In Manus ausführen

Quelle

langwatch

langwatch/langwatch

GitHub-Repository öffnen Creator-Repositorys ansehen

Download

In Manus ausführen

Verwandte BerufeSOC

Basierend auf der SOC-Berufsklassifikation

Sonstige ComputerberufeInformatik- und Mathematikberufe·SOC 15-1299

SKILL.md

readonly

name	evaluations
user-prompt	Help me evaluate my agent
description	Compatibility router for LangWatch evaluation requests. Use only when the user asks for evaluations without making it clear whether they mean pre-deployment experiments or production online evaluations. Routes the request to the focused companion skill and does not implement either workflow itself.
license	MIT
compatibility	Works with Claude Code and similar AI assistants. The `langwatch` CLI is the only interface for platform operations and documentation.

Route an Evaluation Request

This is a compatibility skill. Do not build an experiment, monitor, or guardrail from this skill.

Classify the user's intent:

Intent	Correct skill
Batch test a dataset, compare prompts or models, benchmark, create a CI quality gate	`experiments`
Score live traces or threads, monitor production quality, create a guardrail	`online-evaluations`

If the request remains ambiguous after inspecting context, briefly explain the distinction and route to experiments as the safer pre-deployment default.

Then hand off:

If the correct companion skill is available, load it and follow it instead of continuing here.
If experiments is missing, tell the user to install it with:
```
npx skills@1.5.19 add langwatch/skills/experiments
```
If online-evaluations is missing, tell the user to install it with:
```
npx skills@1.5.19 add langwatch/skills/online-evaluations
```

Do not recreate the companion skill's instructions from memory. Load the focused skill so its current workflow, safety checks, and verification steps are used.

Mehr aus diesem Repository

gleiches Repository

scenarios

langwatch/langwatch

Test your AI agent with simulation-based scenarios. Covers writing scenario test code (Scenario SDK), creating platform scenarios via the `langwatch` CLI, and red teaming for security vulnerabilities. Auto-detects whether to use code or platform approach based on context.

2026-07-223.4k

agent-improve

langwatch/langwatch

Turns production evidence into tested improvements for your AI agent. Forms hypotheses from real traces and analytics, explains the reasoning behind each one, then executes with the user: scenario tests that reproduce production failures, prompt and code changes as reviewable PRs, new evaluators and monitors that capture production signals, and experiments that settle open questions. Use when you want to know what to do next to improve your agent.

2026-07-213.4k

agent-performance

langwatch/langwatch

Deep-dive diagnosis of how your AI agent behaves in production. Explores LangWatch analytics and traces end to end to map failure patterns, dissatisfied users, token cost hotspots, edge cases, behavior changes, and outliers, then delivers an HTML report where every finding links to real example traces. Use when you want to truly understand what your agent is doing in production.

2026-07-213.4k

debug-with-langwatch

langwatch/langwatch

Root-cause production errors and misbehaving agent runs with LangWatch. Finds errored traces, inspects spans, checks monitor and evaluator scores, then narrows to a root cause. Use when something is failing or misbehaving in production — errors, bad answers, latency spikes.

2026-07-213.4k

eval-triage

langwatch/langwatch

Investigate failing experiments and evaluations with LangWatch. Triage a failing experiment run to the exact rows and evaluator scores that regressed, then to a root cause. Use when an experiment fails, scores drop, or evaluations regress.

2026-07-213.4k

setup-lw

langwatch/langwatch

Set up and troubleshoot the LangWatch CLI — login (cloud and self-hosted), endpoint configuration, project selection, and connection problems. Use when the CLI isn't authenticated, can't reach LangWatch, or talks to the wrong project.

2026-07-213.4k

name	evaluations
user-prompt	Help me evaluate my agent
description	Compatibility router for LangWatch evaluation requests. Use only when the user asks for evaluations without making it clear whether they mean pre-deployment experiments or production online evaluations. Routes the request to the focused companion skill and does not implement either workflow itself.
license	MIT
compatibility	Works with Claude Code and similar AI assistants. The `langwatch` CLI is the only interface for platform operations and documentation.

Route an Evaluation Request

This is a compatibility skill. Do not build an experiment, monitor, or guardrail from this skill.

Classify the user's intent:

Intent	Correct skill
Batch test a dataset, compare prompts or models, benchmark, create a CI quality gate	`experiments`
Score live traces or threads, monitor production quality, create a guardrail	`online-evaluations`

If the request remains ambiguous after inspecting context, briefly explain the distinction and route to experiments as the safer pre-deployment default.

Then hand off:

If the correct companion skill is available, load it and follow it instead of continuing here.
If experiments is missing, tell the user to install it with:
```
npx skills@1.5.19 add langwatch/skills/experiments
```
If online-evaluations is missing, tell the user to install it with:
```
npx skills@1.5.19 add langwatch/skills/online-evaluations
```

Do not recreate the companion skill's instructions from memory. Load the focused skill so its current workflow, safety checks, and verification steps are used.