Provides context about the Roo Code evals system structure in this monorepo. Use when tasks mention "evals", "evaluation", "eval runs", "eval exercises", or working with the evals infrastructure. Helps distinguish between the evals execution system (packages/evals, apps/web-evals) and the public website evals display page (apps/web-roo-code/src/app/evals).
Provides context about the Roo Code evals system structure in this monorepo. Use when tasks mention "evals", "evaluation", "eval runs", "eval exercises", or working with the evals infrastructure. Helps distinguish between the evals execution system (packages/evals, apps/web-evals) and the public website evals display page (apps/web-roo-code/src/app/evals).
Evals Codebase Context
When to Use This Skill
Use this skill when the task involves:
Modifying or debugging the evals execution infrastructure
Adding new eval exercises or languages
Working with the evals web interface (apps/web-evals)
Modifying the public evals display page on roocode.com
Understanding where evals code lives in this monorepo
When NOT to Use This Skill
Do NOT use this skill when:
Working on unrelated parts of the codebase (extension, webview-ui, etc.)
The task is purely about the VS Code extension's core functionality
Working on the main website pages that don't involve evals
Key Disambiguation: Two "Evals" Locations
This monorepo has two distinct evals-related locations that can cause confusion:
Component
Path
Purpose
Evals Execution System
packages/evals/
Core eval infrastructure: CLI, DB schema, Docker configs
Evals Management UI
apps/web-evals/
Next.js app for creating/monitoring eval runs (localhost:3446)
