EvalSmith

Grounded forensic evaluation engineering for LLM product repositories. Use when a coding agent needs to inspect an existing codebase, infer the workflow behind a prompt feature, structured output flow, RAG pipeline, tool-calling path, or simple multi-stage chain, then design repo-native evals, capture exact traces, attribute behaviors to prompt or context components, and propose evidence-backed prompt or workflow improvements.

Grounded forensic evaluation engineering for LLM product repositories. Use when a coding agent needs to inspect an existing codebase, infer the workflow behind a prompt feature, structured output flow, RAG pipeline, tool-calling path, or simple multi-stage chain, then design repo-native evals, capture exact traces, attribute behaviors to prompt or context components, and propose evidence-backed prompt or workflow improvements.