Build first evals from a required Ethos, work on existing evaluation suites in a user's repository, derive an environment from trace evidence (experimental), or understand an agent run from NeMo Intake. Owns the evidence standard that every Eval Author…
NVIDIA-NeMo/labs-eval-author
- Latest recorded source activity
- SkillsMP catalog refreshed
- skills collected
- 4
- GitHub stars
- 1
- GitHub forks
- 0
Install with an AI assistant
Copy this prompt into the AI assistant you're using.
Follow https://skillsmp.com/skill-install/prompt.md to install Agent Skills from https://github.com/NVIDIA-NeMo/labs-eval-author.Loading the repository README…
Skills in this repository
Showing 4 of 4 collected skills.
Record whether a repository's Harbor and NeMo Gym evaluations are ready to run, proven in four phases rather than guessed. Probe finds the installed runtimes, Explore finds job configs, datasets, task directories, and Gym manifests, Judge has Harbor and Gym…
Guide coverage audits with milestone check-ins and user-confirmed eval and trace sources. Generate, validate, measure, and report on an audit-spec coverage denominator for Eval Author. Use when the user wants a hand-editable audit.md file derived from Ethos,…
Explore an agent's code and documentation, confirm its intended behavior with the user, and create or update a local ETHOS.md for evaluation and trace analysis. Use when capturing an agent's purpose, boundaries, success criteria, or change permissions.