Menü
SkillsMP hat 4 Skills aus ai-evals-course/evals-skills gesammelt. Öffne einen Skill, um Quelle und Details zu prüfen.
Es werden 4 von 4 gesammelten Skills angezeigt.
Entry point for evals. Use when the user asks for help with evals, does not know where to begin, or asks for something no other skill in this plugin matches. Do NOT use when a more specific skill in this plugin already matches; load that skill directly.
Quellsprache: Englisch
Run error analysis on a dataset. Build a review UI, select diverse samples, monitor annotations, and organize failure modes.
Quellsprache: Englisch
Build a custom browser-based annotation interface tailored to your data for reviewing LLM traces and collecting structured feedback. Use when you need to build an annotation tool, review traces, or collect human labels.
Quellsprache: Englisch
Audit an LLM eval pipeline and surface problems: missing error analysis, unvalidated judges, vanity metrics, etc. Use when inheriting an eval system, when unsure whether evals are trustworthy, or as a starting point when no eval infrastructure exists. Do NOT…
Quellsprache: Englisch