NVIDIA-NeMo/labs-eval-author

eval-author

Build first evals from a required Ethos, work on existing evaluation suites in a user's repository, derive an environment from trace evidence (experimental), or understand an agent run from NeMo Intake. Owns the evidence standard that every Eval Author…

لغة النص الأصلي: الإنجليزية

eval-author-discover

Record whether a repository's Harbor and NeMo Gym evaluations are ready to run, proven in four phases rather than guessed. Probe finds the installed runtimes, Explore finds job configs, datasets, task directories, and Gym manifests, Judge has Harbor and Gym…

لغة النص الأصلي: الإنجليزية

eval-author-audit

Guide coverage audits with milestone check-ins and user-confirmed eval and trace sources. Generate, validate, measure, and report on an audit-spec coverage denominator for Eval Author. Use when the user wants a hand-editable audit.md file derived from Ethos,…

لغة النص الأصلي: الإنجليزية

ethos

Explore an agent's code and documentation, confirm its intended behavior with the user, and create or update a local ETHOS.md for evaluation and trace analysis. Use when capturing an agent's purpose, boundaries, success criteria, or change permissions.

لغة النص الأصلي: الإنجليزية