원클릭으로 Manus에서 모든 스킬 실행

evaluations

스타3,411

포크337

업데이트2026년 7월 20일 23:13

Compatibility router for LangWatch evaluation requests. Use only when the user asks for evaluations without making it clear whether they mean pre-deployment experiments or production online evaluations. Routes the request to the focused companion skill and does not implement either workflow itself.

설치

Codex 또는 Claude로 설치 이 Prompt를 복사해 Codex, Claude 또는 다른 어시스턴트에 붙여 넣으면 Skill 페이지를 검토하고 설치를 진행할 수 있습니다.

Manus에서 실행

출처

langwatch

langwatch/langwatch

GitHub 저장소 열기 Creator 저장소 보기

다운로드

Manus에서 실행

Route an Evaluation Request

This is a compatibility skill. Do not build an experiment, monitor, or guardrail from this skill.

Classify the user's intent:

Intent	Correct skill
Batch test a dataset, compare prompts or models, benchmark, create a CI quality gate	`experiments`
Score live traces or threads, monitor production quality, create a guardrail	`online-evaluations`

If the request remains ambiguous after inspecting context, briefly explain the distinction and route to experiments as the safer pre-deployment default.

Then hand off:

If the correct companion skill is available, load it and follow it instead of continuing here.
If experiments is missing, tell the user to install it with:
```
npx skills@1.5.19 add langwatch/skills/experiments
```
If online-evaluations is missing, tell the user to install it with:
```
npx skills@1.5.19 add langwatch/skills/online-evaluations
```

Do not recreate the companion skill's instructions from memory. Load the focused skill so its current workflow, safety checks, and verification steps are used.

이 저장소의 다른 Skills

같은 저장소

scenarios

langwatch/langwatch

Test your AI agent with simulation-based scenarios. Covers writing scenario test code (Scenario SDK), creating platform scenarios via the `langwatch` CLI, and red teaming for security vulnerabilities. Auto-detects whether to use code or platform approach based on context.

2026-07-223.4k

agent-improve

langwatch/langwatch

Turns production evidence into tested improvements for your AI agent. Forms hypotheses from real traces and analytics, explains the reasoning behind each one, then executes with the user: scenario tests that reproduce production failures, prompt and code changes as reviewable PRs, new evaluators and monitors that capture production signals, and experiments that settle open questions. Use when you want to know what to do next to improve your agent.

2026-07-213.4k

agent-performance

langwatch/langwatch

Deep-dive diagnosis of how your AI agent behaves in production. Explores LangWatch analytics and traces end to end to map failure patterns, dissatisfied users, token cost hotspots, edge cases, behavior changes, and outliers, then delivers an HTML report where every finding links to real example traces. Use when you want to truly understand what your agent is doing in production.

2026-07-213.4k

debug-with-langwatch

langwatch/langwatch

Root-cause production errors and misbehaving agent runs with LangWatch. Finds errored traces, inspects spans, checks monitor and evaluator scores, then narrows to a root cause. Use when something is failing or misbehaving in production — errors, bad answers, latency spikes.

2026-07-213.4k

eval-triage

langwatch/langwatch

Investigate failing experiments and evaluations with LangWatch. Triage a failing experiment run to the exact rows and evaluator scores that regressed, then to a root cause. Use when an experiment fails, scores drop, or evaluations regress.

2026-07-213.4k

setup-lw

langwatch/langwatch

Set up and troubleshoot the LangWatch CLI — login (cloud and self-hosted), endpoint configuration, project selection, and connection problems. Use when the CLI isn't authenticated, can't reach LangWatch, or talks to the wrong project.

2026-07-213.4k

name	evaluations
user-prompt	Help me evaluate my agent
description	Compatibility router for LangWatch evaluation requests. Use only when the user asks for evaluations without making it clear whether they mean pre-deployment experiments or production online evaluations. Routes the request to the focused companion skill and does not implement either workflow itself.
license	MIT
compatibility	Works with Claude Code and similar AI assistants. The `langwatch` CLI is the only interface for platform operations and documentation.

Route an Evaluation Request

This is a compatibility skill. Do not build an experiment, monitor, or guardrail from this skill.

Classify the user's intent:

Intent	Correct skill
Batch test a dataset, compare prompts or models, benchmark, create a CI quality gate	`experiments`
Score live traces or threads, monitor production quality, create a guardrail	`online-evaluations`

If the request remains ambiguous after inspecting context, briefly explain the distinction and route to experiments as the safer pre-deployment default.

Then hand off:

If the correct companion skill is available, load it and follow it instead of continuing here.
If experiments is missing, tell the user to install it with:
```
npx skills@1.5.19 add langwatch/skills/experiments
```
If online-evaluations is missing, tell the user to install it with:
```
npx skills@1.5.19 add langwatch/skills/online-evaluations
```

Do not recreate the companion skill's instructions from memory. Load the focused skill so its current workflow, safety checks, and verification steps are used.