Skip to main content

NVIDIA-NeMo/labs-eval-author

Latest recorded source activity
SkillsMP catalog refreshed
skills collected
4
GitHub stars
1
GitHub forks
0

Install with an AI assistant

Copy this prompt into the AI assistant you're using.

Loading the repository README…

Skills in this repository

classification pending

Showing 4 of 4 collected skills.

occupation
unclassified
description

Build first evals from a required Ethos, work on existing evaluation suites in a user's repository, derive an environment from trace evidence (experimental), or understand an agent run from NeMo Intake. Owns the evidence standard that every Eval Author…

updated
occupation
unclassified
description

Record whether a repository's Harbor and NeMo Gym evaluations are ready to run, proven in four phases rather than guessed. Probe finds the installed runtimes, Explore finds job configs, datasets, task directories, and Gym manifests, Judge has Harbor and Gym…

updated
occupation
unclassified
description

Guide coverage audits with milestone check-ins and user-confirmed eval and trace sources. Generate, validate, measure, and report on an audit-spec coverage denominator for Eval Author. Use when the user wants a hand-editable audit.md file derived from Ethos,…

updated
occupation
unclassified
description

Explore an agent's code and documentation, confirm its intended behavior with the user, and create or update a local ETHOS.md for evaluation and trace analysis. Use when capturing an agent's purpose, boundaries, success criteria, or change permissions.

updated
Showing 4 of 4 collected skills.