| name | eval-harness-plan |
| description | Continue or resume padosoft/eval-harness implementation. Use when working in this Laravel package, following the roadmap, enforcing Laravel 12+/PHP 8.3+ support, Horizon-ready queue design with sync tests, headless report APIs for a separate UI package, branch/PR/Copilot review loops, and progress/lesson documentation. |
Eval Harness Plan
Start Here
Read these files before editing application code:
AGENTS.mddocs/ROADMAP_IMPLEMENTATION_PLAN.mddocs/RULES.mddocs/PROGRESS.mddocs/LESSON.md
Core Rules
- Treat this as a headless Laravel package.
- Support PHP
^8.3 and Laravel ^12.0|^13.0.
- Do not add bundled Web UI assets in this repo.
- Prepare report JSON, read-only API routes, and API resources for a separate UI package.
- Use Laravel queues for batch work; target Horizon operationally and
sync queues/fakes in tests.
- Keep live LLM/embedding/provider calls behind fakeable interfaces.
Procedure
- Re-read current files and
git status before changing anything.
- Keep changes scoped to the current macro/subtask from
docs/ROADMAP_IMPLEMENTATION_PLAN.md.
- Run the relevant local gates:
composer validate --strict
vendor/bin/phpunit
vendor/bin/phpstan analyse --memory-limit=512M
vendor/bin/pint --test
- Update
docs/PROGRESS.md.
- Update
docs/LESSON.md for non-obvious setup facts, bugs, review feedback, or reusable constraints.
- Open PRs according to
AGENTS.md: subtask PR into macro branch, macro PR into main.
- Request GitHub Copilot Code Review and wait for CI/review completion.
- If remote review or CI cannot be completed, record the exact blocker and next required step in
docs/PROGRESS.md.
Copilot Review Fallback
Prefer:
gh pr edit <PR> --add-reviewer copilot
If that fails before requesting the review because read:project is missing, use the GraphQL requestReviewsByLogin fallback documented in docs/RULES.md.
