Skip to main content

nat-evaluation

Use when designing, configuring, running, or troubleshooting NeMo Agent Toolkit evaluations, datasets, evaluator selection, ATIF surfaces, quality gates, custom evaluators, and `nat eval`.

Source facts

Repository
NVIDIA/NeMo-Agent-Toolkit
Last source activity
October 29, 2026 at 14:19
Detected SKILL.md language
English
Stars
2,695
Forks
826

Install options

The review-first prompt is selected by default. You can switch to a direct command or download a local copy.

Review the source files

Read SKILL.md and any companion files shown by SkillsMP before deciding whether to install.

File Explorer
13 files

Showing SKILL.md

SKILL.md
Source instructions · Read-only preview
name
nat-evaluation
description
Use when designing, configuring, running, or troubleshooting NeMo Agent Toolkit evaluations, datasets, evaluator selection, ATIF surfaces, quality gates, custom evaluators, and `nat eval`.
author
NVIDIA Corporation and Affiliates
license
Apache-2.0
# NeMo Agent Toolkit Evaluation Use this skill for measuring agent quality and behavior. ## Workflow 1. Decide the evaluation surface and output format. 2. Decompose quality goals into separate evaluators. 3. Choose built-in evaluators before writing custom evaluators. 4. Keep datasets small and explicit for local validation. 5. Run `nat eval` and inspect generated artifacts. ## References - `references/operating-mode.md` - `references/methodology.md` - `references/agent-eval-framework.md` - `references/evaluation-surfaces.md` - `references/evaluation-contract.md` - `references/evaluators/` - `references/code-patterns.md`
View on GitHub