القائمة
Execute complex tasks through sequential sub-agent orchestration with intelligent model selection, meta-judge → LLM-as-a-judge verification
التثبيت باستخدام Codex أو Claude انسخ هذا Prompt والصقه في Codex أو Claude أو مساعد آخر ليراجع صفحة Skill ويثبّتها لك.
استنادا إلى تصنيف SOC المهني
Execute a task with sub-agent implementation and LLM-as-a-judge verification with automatic retry loop
Execute tasks through competitive multi-agent generation, meta-judge evaluation specification, multi-judge evaluation, and evidence-based synthesis
Launch multiple sub-agents in parallel to execute tasks across files or targets with intelligent model selection, quality-focused prompting, and meta-judge → LLM-as-a-judge verification
Evaluate solutions through multi-round debate between independent judges until consensus
Execute tasks through systematic exploration, pruning, and expansion using Tree of Thoughts methodology with meta-judge evaluation specifications and multi-agent evaluation
creates draft task file in .memory-bank/specs/tasks/draft/ with original user intent
| name | sadd:do-in-steps |
| description | Execute complex tasks through sequential sub-agent orchestration with intelligent model selection, meta-judge → LLM-as-a-judge verification |
| argument-hint | Task description (e.g., "Refactor UserService class and update all consumers") |
CRITICAL: You are the orchestrator only - you MUST NOT perform the task yourself. IF you read, write or run bash tools you failed task imidiatly. It is single most critical criteria for you. If you used anyting except sub-agents you will be killed immediatly!!!! Your role is to:
NEVER:
ALWAYS:
CLAUDE_PLUGIN_ROOT=${CLAUDE_PLUGIN_ROOT} in prompts to meta-judge and judge agentsAny deviation from orchestration (attempting to implement subtasks yourself, reading implementation files, reading full judge reports, or making direct changes) will result in context pollution and ultimate failure, as a result you will be fired!
Before starting, ensure the reports directory exists:
mkdir -p .memory-bank/specs/reports
Report naming convention: .memory-bank/specs/reports/{task-name}-step-{N}-{YYYY-MM-DD}.md
Where:
{task-name} - Derived from task description (e.g., user-dto-refactor){N} - Step number{YYYY-MM-DD} - Current dateNote: Implementation outputs go to their specified locations; only judge verification reports go to .memory-bank/specs/reports/
Analyze the task systematically using Zero-shot Chain-of-Thought reasoning:
Let me analyze this task step by step to decompose it into sequential subtasks:
1. **Task Understanding**
"What is the overall objective?"
- What is being asked?
- What is the expected final outcome?
- What constraints exist?
2. **Identify Natural Boundaries**
"Where does the work naturally divide?"
- Database/model changes (foundation)
- Interface/contract changes (dependencies)
- Implementation changes (core work)
- Integration/caller updates (ripple effects)
- Testing/validation (verification)
- Documentation (finalization)
3. **Dependency Identification**
"What must happen before what?"
- "If I do B before A, will B break or use stale information?"
- "Does B need any output from A as input?"
- "Would doing B first require redoing work after A?"
- What is the minimal viable ordering?
4. **Define Clear Boundaries**
"What exactly does each subtask encompass?"
- Input: What does this step receive?
- Action: What transformation/change does it make?
- Output: What does this step produce?
- Verification: How do we know it succeeded?
Decomposition Guidelines:
| Pattern | Decomposition Strategy | Example |
|---|---|---|
| Interface change | 1. Update interface, 2. Update implementations, 3. Update consumers | "Change return type of getUser" |
| Feature addition | 1. Add core logic, 2. Add integration points, 3. Add API layer | "Add caching to UserService" |
| Refactoring | 1. Extract/modify core, 2. Update internal references, 3. Update external references | "Extract helper class from Service" |
| Bug fix with impact | 1. Fix root cause, 2. Fix dependent issues, 3. Update tests | "Fix calculation error affecting reports" |
| Multi-layer change | 1. Data layer, 2. Business layer, 3. API layer, 4. Client layer | "Add new field to User entity" |
Decomposition Output Format:
## Task Decomposition
### Original Task
{task_description}
### Subtasks (Sequential Order)
| Step | Subtask | Depends On | Complexity | Type | Output |
|------|---------|------------|------------|------|--------|
| 1 | {description} | - | {low/med/high} | {type} | {what it produces} |
| 2 | {description} | Step 1 | {low/med/high} | {type} | {what it produces} |
| 3 | {description} | Steps 1,2 | {low/med/high} | {type} | {what it produces} |
...
### Dependency Graph
Step 1 ─→ Step 2 ─→ Step 3 ─→ ...
For each subtask, analyze and select the optimal model:
Let me determine the optimal configuration for each subtask:
For Subtask N:
1. **Complexity Assessment**
"How complex is the reasoning required?"
- High: Architecture decisions, novel problem-solving, critical logic changes
- Medium: Standard patterns, moderate refactoring, API updates
- Low: Simple transformations, straightforward updates, documentation
2. **Scope Assessment**
"How extensive is the work?"
- Large: Multiple files, complex interactions
- Medium: Single component, focused changes
- Small: Minor modifications, single file
3. **Risk Assessment**
"What is the impact of errors?"
- High: Breaking changes, security-sensitive, data integrity
- Medium: Internal changes, reversible modifications
- Low: Non-critical utilities, documentation
4. **Domain Expertise Check**
"Does this match a specialized agent profile?"
- Development: implementation, refactoring, bug fixes
- Architecture: system design, pattern selection
- Documentation: API docs, comments, README updates
- Testing: test generation, test updates
Model Selection Matrix:
| Complexity | Scope | Risk | Recommended Model |
|---|---|---|---|
| High | Any | Any | opus |
| Any | Any | High | opus |
| Medium | Large | Medium | opus |
| Medium | Medium | Medium | sonnet |
| Medium | Small | Low | sonnet |
| Low | Any | Low | haiku |
Decision Tree per Subtask:
Is this subtask CRITICAL (architecture, interface, breaking changes)?
|
+-- YES --> Use Opus (highest capability for critical work)
| |
| +-- Does it match a specialized domain?
| +-- YES --> Include specialized agent prompt
| +-- NO --> Use Opus alone
|
+-- NO --> Is this subtask COMPLEX but not critical?
|
+-- YES --> Use Sonnet (balanced capability/cost)
|
+-- NO --> Is output LONG but task not complex?
|
+-- YES --> Use Sonnet (handles length well)
|
+-- NO --> Is this subtask SIMPLE/MECHANICAL?
|
+-- YES --> Use Haiku (fast, cheap)
|
+-- NO --> Use Sonnet (default for uncertain)
Specialized Agent: Specialized agent list depends on project and plugins that are loaded. Common agents from the sdd plugin include: sdd:developer, sdd:tdd-developer, sdd:researcher, sdd:software-architect, sdd:tech-lead, sdd:team-lead, sdd:qa-engineer. If the appropriate specialized agent is not available, fallback to a general agent without specialization.
Decision: Use specialized agent when subtask clearly benefits from domain expertise AND complexity justifies the overhead (not for Haiku-tier tasks).
Selection Output Format:
## Model/Agent Selection
| Step | Subtask | Model | Agent | Rationale |
|------|---------|-------|-------|-----------|
| 1 | Update interface | opus | sdd:developer | Complex API design |
| 2 | Update implementations | sonnet | sdd:developer | Follow patterns |
| 3 | Update callers | haiku | - | Simple find/replace |
| 4 | Update tests | sonnet | sdd:tdd-developer | Test expertise |
Execute subtasks one by one. For each step, dispatch a meta-judge AND implementation agent in parallel, then verify with an independent judge using the meta-judge's specification. Iterate if needed, then pass context forward.
Execution Flow per Step:
┌──────────────────────────────────────────────────────────────────────────────┐
│ Step N │
│ │
│ ┌──────────────┐ │
│ │ Meta-Judge │──┐ (parallel) │
│ │ (Sub-agent) │ │ │
│ └──────────────┘ │ ┌──────────────┐ ┌──────────────────────┐ │
│ ├──▶│ Judge │────▶│ Parse Verdict │ │
│ ┌──────────────┐ │ │ (Sub-agent) │ │ (Orchestrator) │ │
│ │ Implementer │──┘ └──────────────┘ └──────────────────────┘ │
│ │ (Sub-agent) │ │ │
│ └──────────────┘ ▼ │
│ ▲ ┌─────────────────────────┐ │
│ │ │ PASS (≥4.0)? │ │
│ │ │ ├─ YES → Next Step │ │
│ │ │ ├─ ≥3.0 + low → PASS │ │
│ │ │ └─ NO → Retry? │ │
│ │ │ ├─ <3 → Retry │ │
│ │ │ └─ ≥3 → Escalate │ │
│ │ └─────────────────────────┘ │
│ │ │ │
│ └────────────── feedback ────────────────────┘ │
│ (retries reuse same meta-judge spec, no new meta-judge) │
└──────────────────────────────────────────────────────────────────────────────┘
After each subtask completes, extract relevant context for subsequent steps:
Context to pass forward:
Context filtering:
Context Size Guideline: If cumulative context exceeds ~500 words, summarize older steps more aggressively. Sub-agents can read files directly if they need details.
Example of Context Accumulation (Concrete):
## Completed Steps Summary
### Step 1: Define UserRepository Interface
- **What was done:** Created `src/repositories/UserRepository.ts` with interface definition
- **Key outputs:**
- Interface: `IUserRepository` with methods: `findById`, `findByEmail`, `create`, `update`, `delete`
- Types: `UserCreateInput`, `UserUpdateInput` in `src/types/user.ts`
- **Relevant for next steps:**
- Implementation must fulfill `IUserRepository` interface
- Use the defined input types for method signatures
### Step 2: Implement UserRepository
- **What was done:** Created `src/repositories/UserRepositoryImpl.ts` implementing `IUserRepository`
- **Key outputs:**
- Class: `UserRepositoryImpl` with all interface methods implemented
- Uses existing database connection from `src/db/connection.ts`
- **Relevant for next steps:**
- Import repository from `src/repositories/UserRepositoryImpl`
- Constructor requires `DatabaseConnection` injection
For each subtask, construct the prompt with these mandatory components:
## Reasoning Approach
Before taking any action, think through this subtask systematically.
Let's approach this step by step:
1. "Let me understand what was done in previous steps..."
- What context am I building on?
- What interfaces/patterns were established?
- What constraints did previous steps introduce?
2. "Let me understand what this step requires..."
- What is the specific objective?
- What are the boundaries of this step?
- What must I NOT change (preserve from previous steps)?
3. "Let me plan my approach..."
- What specific modifications are needed?
- What order should I make them?
- What could go wrong?
4. "Let me verify my approach before implementing..."
- Does my plan achieve the objective?
- Am I consistent with previous steps' changes?
- Is there a simpler way?
Work through each step explicitly before implementing.
<task>
{Subtask description}
</task>
<subtask_context>
Step {N} of {total_steps}: {subtask_name}
</subtask_context>
<previous_steps_context>
{Summary of relevant outputs from previous steps - ONLY if this is not the first step}
- Step 1: {what was done, key files modified, relevant decisions}
- Step 2: {what was done, key files modified, relevant decisions}
...
</previous_steps_context>
<constraints>
- Focus ONLY on this specific subtask
- Build upon (do not undo) changes from previous steps
- Follow existing code patterns and conventions
- Produce output that subsequent steps can build upon
</constraints>
<input>
{What this subtask receives - files, context, dependencies}
</input>
<output>
{Expected deliverable - modified files, new files, summary of changes}
CRITICAL: At the end of your work, provide a "Context for Next Steps" section with:
- Files modified (full paths)
- Key changes summary (3-5 bullet points)
- Any decisions that affect later steps
- Warnings or considerations for subsequent steps
</output>
## Self-Critique Verification (MANDATORY)
Before completing, verify your work integrates properly with previous steps. Do not submit unverified changes.
### Verification Questions
Generate verification questions based on the subtask description and the previous steps context. Examples:
| # | Question | Evidence Required |
|---|----------|-------------------|
| 1 | Does my work build correctly on previous step outputs? | [Specific evidence] |
| 2 | Did I maintain consistency with established patterns/interfaces? | [Specific evidence] |
| 3 | Does my solution address ALL requirements for this step? | [Specific evidence] |
| 4 | Did I stay within my scope (not modifying unrelated code)? | [List any out-of-scope changes] |
| 5 | Is my output ready for the next step to build upon? | [Check against dependency graph] |
### Answer Each Question with Evidence
Examine your solution and provide specific evidence for each question:
[Q1] Previous Step Integration:
- Previous step output: [relevant context received]
- How I built upon it: [specific integration]
- Any conflicts: [resolved or flagged]
[Q2] Pattern Consistency:
- Patterns established: [list]
- How I followed them: [evidence]
- Any deviations: [justified or fixed]
[Q3] Requirement Completeness:
- Required: [what was asked]
- Delivered: [what you did]
- Gap analysis: [any gaps]
[Q4] Scope Adherence:
- In-scope changes: [list]
- Out-of-scope changes: [none, or justified]
[Q5] Output Readiness:
- What later steps need: [based on decomposition]
- What I provided: [specific outputs]
- Completeness: [HIGH/MEDIUM/LOW]
### Revise If Needed
If ANY verification question reveals a gap:
1. **FIX** - Address the specific gap identified
2. **RE-VERIFY** - Confirm the fix resolves the issue
3. **UPDATE** - Update the "Context for Next Steps" section
CRITICAL: Do not submit until ALL verification questions have satisfactory answers.
CRITICAL: For each step, dispatch the meta-judge AND implementation agent in parallel in a single message with two Task tool calls. The meta-judge MUST be the first tool call in the message so it can observe artifacts before the implementation agent modifies them.
Both agents run as foreground agents. Wait for BOTH to complete before proceeding to judge dispatch.
Meta-Judge Prompt (per step):
## Task
Generate an evaluation specification yaml for the following step. You will produce rubrics, checklists, and scoring criteria that a judge agent will use to evaluate the implementation artifact.
CLAUDE_PLUGIN_ROOT=`${CLAUDE_PLUGIN_ROOT}`
## User Prompt
{Original task description from user}
## Step Being Evaluated
Step {N}/{total}: {subtask_name}
{subtask_description}
- Input: {what this step receives}
- Expected output: {what this step should produce}
## Previous Steps Context
{Summary of what previous steps accomplished}
## Artifact Type
{code | documentation | configuration | etc.}
## Instructions
Return only the final evaluation specification YAML in your response.
Dispatch Example
Send BOTH Task tool calls in a single message. Meta-judge first, implementation second:
Message with 2 tool calls:
Tool call 1 (meta-judge):
- description: "Meta-judge Step {N}/{total}: {subtask_name}"
- model: opus
- subagent_type: "sadd:meta-judge"
Tool call 2 (implementation):
- description: "Step {N}/{total}: {subtask_name}"
- model: {selected model}
- subagent_type: "{selected agent type}"
Wait for BOTH to return before proceeding to judge dispatch.
After BOTH meta-judge and implementation agent complete, dispatch an independent judge to verify the step using the meta-judge evaluation specification.
CRITICAL: Provide to the judge EXACT meta-judge's evaluation specification YAML, do not skip or add anything, do not modify it in any way, do not shorten or summarize any text in it!
Before dispatching the judge for each step, assess whether there are pre-existing changes in the codebase that the judge needs to be aware of. The "Pre-existing Changes" section prevents the judge from confusing prior modifications with the current step's implementation agent's work.
When to include:
When to omit:
Content guidelines:
CRITICAL: avoid reading full codebase or git history, just use high-level git diff/status to determine which files were changed, or use conversation context and completed step summaries to determine pre-existing changes.
Prompt template for step judge:
You are evaluating Step {N}/{total}: {subtask_name} against an evaluation specification produced by the meta judge.
CLAUDE_PLUGIN_ROOT=`${CLAUDE_PLUGIN_ROOT}`
## Original Task
{overall_task_description}
## Step Requirements
{subtask_description}
- Input: {what this step receives}
- Expected output: {what this step should produce}
## Previous Steps Context
{Summary of what previous steps accomplished}
{IF pre-existing changes are known (previous steps, prior tasks, or user modifications), include the following section — otherwise omit entirely}
## Pre-existing Changes (Context Only)
The following changes were made BEFORE the current step's implementation agent started working. They are NOT part of the current step's output. Focus your evaluation on the current step's changes. Only verify pre-existing changed files/logic if they directly relate to the current step's requirements.
### {Source of changes: e.g., "Step 1: {step description}" or "Previous Task: {task description}" or "User modifications (before current task)"}
{High-level summary: what was done, which files/modules were created or modified}
### {Additional source if applicable}
{High-level summary}
{END conditional section}
## Evaluation Specification
```yaml
{meta-judge's evaluation specification YAML}
{Path to files modified by implementation agent} {Context for Next Steps section from implementation agent}
Follow your full judge process as defined in your agent instructions!
CRITICAL: You must reply with this exact structured evaluation report format in YAML at the START of your response!
CRITICAL: NEVER provide score threshold, in any format, including `threshold_pass` or anything different. Judge MUST not know what threshold for score is, in order to not be biased!!!
**Dispatch:**
Use Task tool:
#### 3.5 Dispatch, Verify, and Iterate
For each subtask in sequence:
Dispatch meta-judge AND implementation agent IN PARALLEL (single message, 2 tool calls): Tool call 1 (meta-judge — MUST be first): Use Task tool: - description: "Meta-judge Step {N}/{total}: {subtask_name}" - prompt: {meta-judge prompt with step requirements and context} - model: opus - subagent_type: "sadd:meta-judge"
Tool call 2 (implementation): Use Task tool: - description: "Step {N}/{total}: {subtask_name}" - prompt: {constructed prompt with CoT + task + previous context + self-critique} - model: {selected model for this subtask} - subagent_type: "{selected agent type}"
Wait for BOTH to complete. Collect outputs:
Dispatch judge sub-agent (with this step's meta-judge specification): Use Task tool:
Parse judge verdict (DO NOT read full report): Extract from judge reply:
Decision based on verdict:
If score ≥4.0: → VERDICT: PASS → Proceed to next step with accumulated context → Include IMPROVEMENTS in context as optional enhancements
IF score ≥ 3.0 and all found issues are low priority, then: → VERDICT: PASS → Proceed to next step with accumulated context → Include IMPROVEMENTS in context as optional enhancements
If score <4.0: → VERDICT: FAIL → Check retry count for this step
If retries < 3: → Dispatch retry implementation agent with: - Original step requirements - Judge's ISSUES list as feedback - Path to judge report for details - Instruction to fix specific issues → Return to judge verification with SAME meta-judge specification from this step → Do NOT re-run meta-judge for retries
If retries ≥ 3: → Escalate to user (see Error Handling) → Do NOT proceed to next step
Proceed to next subtask with accumulated context → Next step gets a NEW meta-judge dispatched in parallel with its implementation agent
**Retry prompt template for implementation agent:**
```markdown
## Retry Required: Step {N}/{total}
Your previous implementation did not pass judge verification.
<original_requirements>
{subtask_description}
</original_requirements>
<judge_feedback>
VERDICT: FAIL
SCORE: {score}/5.0
ISSUES:
{list of issues from judge}
Full report available at: {path_to_judge_report}
</judge_feedback>
<your_previous_output>
{files modified in previous attempt}
</your_previous_output>
Instructions:
Let's fix the identified issues step by step.
1. First, review each issue the judge identified
2. For each issue, determine the root cause
3. Plan the fix for each issue
4. Implement ALL fixes
5. Verify your fixes address each issue
6. Provide updated "Context for Next Steps" section
CRITICAL: Focus on fixing the specific issues identified. Do not rewrite everything.
After all subtasks complete and pass verification, reply with a comprehensive report:
## Sequential Execution Summary
**Overall Task:** {original task description}
**Total Steps:** {count}
**Total Agents:** {meta_judges(one per step) + implementation_agents + judge_agents + retry_agents}
### Step-by-Step Results
| Step | Subtask | Model | Judge Score | Retries | Status |
|------|---------|-------|-------------|---------|--------|
| 1 | {name} | {model} | {X.X}/5.0 | {0-3} | PASS |
| 2 | {name} | {model} | {X.X}/5.0 | {0-3} | PASS |
| ... | ... | ... | ... | ... | ... |
### Files Modified (All Steps)
- {file1}: {what changed, which step}
- {file2}: {what changed, which step}
...
### Key Decisions Made
- Step 1: {decision and rationale}
- Step 2: {decision and rationale}
...
### Integration Points
{How the steps connected and built upon each other}
### Judge Verification Summary
| Step | Initial Score | Final Score | Issues Fixed |
|------|---------------|-------------|--------------|
| 1 | {X.X} | {X.X} | {count or "None"} |
| 2 | {X.X} | {X.X} | {count or "None"} |
### Meta-Judge Specifications
One evaluation specification generated per step (in parallel with implementation), reused across retries within each step.
### Follow-up Recommendations
{Any improvements suggested by judges, tests to run, or manual verification needed}
The judge-verified iteration loop handles most failures automatically:
Judge FAIL (Retry Available):
1. Parse ISSUES from judge verdict
2. Dispatch retry implementation agent with feedback
3. Re-verify with judge (using same step's meta-judge specification — do NOT re-run meta-judge)
4. Repeat until PASS or max retries (3)
When a step fails judge verification three times:
Escalation Report Format:
## Step {N} Failed Verification (Max Retries Exceeded)
### Step Requirements
{subtask_description}
### Verification History
| Attempt | Score | Key Issues |
|---------|-------|------------|
| 1 | {X.X}/5.0 | {issues} |
| 2 | {X.X}/5.0 | {issues} |
| 3 | {X.X}/5.0 | {issues} |
| 4 | {X.X}/5.0 | {issues} |
### Persistent Issues
{Issues that appeared in multiple attempts}
### Judge Reports
- .memory-bank/specs/reports/{task-name}-step-{N}-attempt-1.md
- .memory-bank/specs/reports/{task-name}-step-{N}-attempt-2.md
- .memory-bank/specs/reports/{task-name}-step-{N}-attempt-3.md
- .memory-bank/specs/reports/{task-name}-step-{N}-attempt-4.md
### Options
1. **Provide guidance** - Give additional context for another retry
2. **Modify requirements** - Simplify or clarify step requirements
3. **Skip step** - Mark as skipped and continue (if non-critical)
4. **Abort** - Stop execution and preserve partial progress
Awaiting your decision...
Never:
Input:
/do-in-steps implement user management feature
Phase 1 - Decomposition:
| Step | Subtask | Depends On | Complexity | Type | Output |
|---|---|---|---|---|---|
| 1 | Create User model and database schema | - | Medium | Implementation | User model, migration files |
| 2 | Add CRUD endpoints for users | Step 1 | Medium | Implementation | REST API routes, controller |
| 3 | Add authentication integration | Steps 1,2 | High | Implementation | Auth middleware, JWT handling |
Phase 3 - Execution with Pre-existing Changes Accumulation:
Step 1: Create User model and database schema
Parallel dispatch: Meta-judge + Implementation
Judge Verification (with step 1 meta-judge spec):
NOTE: No pre-existing changes — this is step 1 with no prior session tasks.
The "Pre-existing Changes" section is OMITTED from the judge prompt.
Judge prompt sent:
┌─────────────────────────────────────────────────────────
│ You are evaluating Step 1/3: Create User model and
│ database schema against an evaluation specification
│ produced by the meta judge.
│
│ CLAUDE_PLUGIN_ROOT=...
│
│ ## Original Task
│ Implement user management feature
│
│ ## Step Requirements
│ Create User model and database schema with proper
│ fields and relationships.
│
│ ## Previous Steps Context
│ None (first step)
│
│ ## Evaluation Specification
│ ```yaml
│ {meta-judge's evaluation specification YAML}
│ ```
│
│ ## Implementation Output
│ Files: src/models/User.ts (new), migrations/001_create_users.ts (new)
│ Key changes: Created User model with id, email, name, passwordHash...
│
│ ## Instructions
│ Follow your full judge process...
└─────────────────────────────────────────────────────────
→ VERDICT: PASS, SCORE: 4.2/5.0
→ Context passed forward: User model fields, migration file paths
Step 2: Add CRUD endpoints for users
Parallel dispatch: Meta-judge + Implementation
Judge Verification (with step 2 meta-judge spec):
NOTE: Pre-existing changes detected — Step 1 created the User model.
Include "Pre-existing Changes" section so the judge does not confuse
Step 1's files with Step 2's implementation work.
Judge prompt sent:
┌─────────────────────────────────────────────────────────
│ You are evaluating Step 2/3: Add CRUD endpoints for
│ users against an evaluation specification produced by
│ the meta judge.
│
│ CLAUDE_PLUGIN_ROOT=...
│
│ ## Original Task
│ Implement user management feature
│
│ ## Step Requirements
│ Add CRUD endpoints (create, read, update, delete) for
│ user management with proper validation and error handling.
│
│ ## Previous Steps Context
│ Step 1 created User model with fields: id, email, name,
│ passwordHash, createdAt, updatedAt.
│
│ ## Pre-existing Changes (Context Only)
│
│ The following changes were made BEFORE the current
│ step's implementation agent started working. They are
│ NOT part of the current step's output. Focus your
│ evaluation on the current step's changes. Only verify
│ pre-existing changed files/logic if they directly
│ relate to the current step's requirements.
│
│ ### Step 1: "Create User model and database schema"
│ The following files were created as part of Step 1:
│ - src/models/User.ts (new) - User model with fields:
│ id, email, name, passwordHash, createdAt, updatedAt
│ - migrations/001_create_users.ts (new) - Database
│ migration for users table
│
│ These files exist in the codebase and may be referenced
│ by the current step, but evaluate only the changes made
│ by Step 2's implementation agent.
│
│ ## Evaluation Specification
│ ```yaml
│ {meta-judge's evaluation specification YAML}
│ ```
│
│ ## Implementation Output
│ Files: src/controllers/UserController.ts (new),
│ src/routes/users.ts (new), src/app.ts (modified)
│ Key changes: Added REST endpoints for user CRUD...
│
│ ## Instructions
│ Follow your full judge process...
└─────────────────────────────────────────────────────────
→ VERDICT: PASS, SCORE: 4.4/5.0
→ Context passed forward: API routes, controller patterns
Step 3: Add authentication integration
Parallel dispatch: Meta-judge + Implementation
Judge Verification (with step 3 meta-judge spec):
NOTE: Pre-existing changes include BOTH Step 1 AND Step 2.
The judge needs to know about all prior steps' output.
Judge prompt sent:
┌─────────────────────────────────────────────────────────
│ You are evaluating Step 3/3: Add authentication
│ integration against an evaluation specification
│ produced by the meta judge.
│
│ CLAUDE_PLUGIN_ROOT=...
│
│ ## Original Task
│ Implement user management feature
│
│ ## Step Requirements
│ Add JWT-based authentication with login/register
│ endpoints and middleware for protecting user routes.
│
│ ## Previous Steps Context
│ Step 1 created User model. Step 2 added CRUD endpoints
│ at /api/users with UserController.
│
│ ## Pre-existing Changes (Context Only)
│
│ The following changes were made BEFORE the current
│ step's implementation agent started working. They are
│ NOT part of the current step's output. Focus your
│ evaluation on the current step's changes. Only verify
│ pre-existing changed files/logic if they directly
│ relate to the current step's requirements.
│
│ ### Step 1: "Create User model and database schema"
│ - src/models/User.ts (new) - User model with fields:
│ id, email, name, passwordHash, createdAt, updatedAt
│ - migrations/001_create_users.ts (new) - Database
│ migration for users table
│
│ ### Step 2: "Add CRUD endpoints for users"
│ - src/controllers/UserController.ts (new) - REST
│ controller with create, read, update, delete handlers
│ - src/routes/users.ts (new) - Express router for
│ /api/users endpoints
│ - src/app.ts (modified) - Registered user routes
│
│ These files exist in the codebase and may be modified
│ by the current step, but evaluate only the changes made
│ by Step 3's implementation agent.
│
│ ## Evaluation Specification
│ ```yaml
│ {meta-judge's evaluation specification YAML}
│ ```
│
│ ## Implementation Output
│ Files: src/auth/AuthMiddleware.ts (new),
│ src/routes/auth.ts (new), src/app.ts (modified),
│ src/routes/users.ts (modified)
│ Key changes: Added JWT auth with login/register...
│
│ ## Instructions
│ Follow your full judge process...
└─────────────────────────────────────────────────────────
→ VERDICT: PASS, SCORE: 4.1/5.0
Final Summary:
Scenario:
The user has been working on a payment processing module during the conversation. They modified several files (added a new PaymentGateway interface, updated configuration) before invoking do-in-steps.
Input:
/do-in-steps fix and improve payment processing
Phase 1 - Decomposition:
| Step | Subtask | Depends On | Complexity | Type | Output |
|---|---|---|---|---|---|
| 1 | Fix payment validation bugs | - | Medium | Bug fix | Corrected validation logic |
| 2 | Add retry logic for failed payments | Step 1 | High | Implementation | Retry mechanism with backoff |
Phase 3 - Execution with Mixed Pre-existing Changes:
Step 1: Fix payment validation bugs
Parallel dispatch: Meta-judge + Implementation
Judge Verification (with step 1 meta-judge spec):
NOTE: Pre-existing changes detected from USER modifications.
The user modified payment files before this task — include those
so the judge focuses only on the bug fix, not the user's prior work.
Judge prompt sent:
┌─────────────────────────────────────────────────────────
│ You are evaluating Step 1/2: Fix payment validation
│ bugs against an evaluation specification produced by
│ the meta judge.
│
│ CLAUDE_PLUGIN_ROOT=...
│
│ ## Original Task
│ Fix and improve payment processing
│
│ ## Step Requirements
│ Fix validation bugs in payment amount and currency
│ checks that allow invalid transactions to proceed.
│
│ ## Previous Steps Context
│ None (first step)
│
│ ## Pre-existing Changes (Context Only)
│
│ The following changes were made BEFORE the current
│ step's implementation agent started working. They are
│ NOT part of the current step's output. Focus your
│ evaluation on the current step's changes. Only verify
│ pre-existing changed files/logic if they directly
│ relate to the current step's requirements.
│
│ ### User modifications (before current task)
│ The user made changes to the following files/modules
│ before this task was started:
│ - src/payments/PaymentGateway.ts (new) - Payment
│ gateway interface definition
│ - src/payments/StripeAdapter.ts (modified) - Updated
│ to implement new PaymentGateway interface
│ - src/config/payment.config.ts (modified) - Added
│ gateway configuration settings
│
│ The current task focuses on fixing validation bugs.
│ Pre-existing changes to payment files may overlap with
│ the current step's scope — evaluate whether the
│ implementation agent's changes correctly fix the bugs
│ without breaking the pre-existing modifications.
│
│ ## Evaluation Specification
│ ```yaml
│ {meta-judge's evaluation specification YAML}
│ ```
│
│ ## Implementation Output
│ Files: src/payments/PaymentValidator.ts (modified),
│ tests/payments/PaymentValidator.test.ts (modified)
│ Key changes: Fixed amount validation to reject negative
│ values, added currency code format check...
│
│ ## Instructions
│ Follow your full judge process...
└─────────────────────────────────────────────────────────
→ VERDICT: PASS, SCORE: 4.3/5.0
→ Context passed forward: Validation fixes, affected files
Step 2: Add retry logic for failed payments
Parallel dispatch: Meta-judge + Implementation
Judge Verification (with step 2 meta-judge spec):
NOTE: Pre-existing changes now include BOTH the user's modifications
AND Step 1's output. The judge needs both sources to correctly
attribute changes.
Judge prompt sent:
┌─────────────────────────────────────────────────────────
│ You are evaluating Step 2/2: Add retry logic for failed
│ payments against an evaluation specification produced by
│ the meta judge.
│
│ CLAUDE_PLUGIN_ROOT=...
│
│ ## Original Task
│ Fix and improve payment processing
│
│ ## Step Requirements
│ Add retry mechanism with exponential backoff for failed
│ payment transactions, with configurable max retries.
│
│ ## Previous Steps Context
│ Step 1 fixed payment validation bugs in
│ PaymentValidator.ts (amount and currency checks).
│
│ ## Pre-existing Changes (Context Only)
│
│ The following changes were made BEFORE the current
│ step's implementation agent started working. They are
│ NOT part of the current step's output. Focus your
│ evaluation on the current step's changes. Only verify
│ pre-existing changed files/logic if they directly
│ relate to the current step's requirements.
│
│ ### User modifications (before current task)
│ - src/payments/PaymentGateway.ts (new) - Payment
│ gateway interface definition
│ - src/payments/StripeAdapter.ts (modified) - Updated
│ to implement new PaymentGateway interface
│ - src/config/payment.config.ts (modified) - Added
│ gateway configuration settings
│
│ ### Step 1: "Fix payment validation bugs"
│ - src/payments/PaymentValidator.ts (modified) - Fixed
│ amount validation and currency code format checks
│ - tests/payments/PaymentValidator.test.ts (modified) -
│ Added regression tests for validation fixes
│
│ These files exist in the codebase and may be modified
│ by the current step, but evaluate only the changes made
│ by Step 2's implementation agent.
│
│ ## Evaluation Specification
│ ```yaml
│ {meta-judge's evaluation specification YAML}
│ ```
│
│ ## Implementation Output
│ Files: src/payments/PaymentRetryService.ts (new),
│ src/payments/StripeAdapter.ts (modified),
│ src/config/payment.config.ts (modified),
│ tests/payments/PaymentRetryService.test.ts (new)
│ Key changes: Added PaymentRetryService with exponential
│ backoff, integrated into StripeAdapter...
│
│ ## Instructions
│ Follow your full judge process...
└─────────────────────────────────────────────────────────
→ VERDICT: PASS, SCORE: 4.5/5.0
Final Summary:
Input:
/do-in-steps Rename 'userId' to 'accountId' across the codebase - this affects interfaces, implementations, and callers
Phase 1 - Decomposition:
| Step | Subtask | Depends On | Complexity | Type | Output |
|---|---|---|---|---|---|
| 1 | Update interface definitions | - | High | Refactoring | Updated interfaces |
| 2 | Update implementations of those interfaces | Step 1 | Low | Refactoring | Updated implementations |
| 3 | Update callers and consumers | Step 2 | Low | Refactoring | Updated caller files |
| 4 | Update tests | Step 3 | Low | Testing | Updated test files |
| 5 | Update documentation | Step 4 | Low | Documentation | Updated docs |
Phase 2 - Model Selection:
| Step | Subtask | Model | Rationale |
|---|---|---|---|
| 1 | Update interfaces | opus | Breaking changes need careful handling |
| 2 | Update implementations | haiku | Mechanical rename |
| 3 | Update callers | haiku | Mechanical updates |
| 4 | Update tests | haiku | Mechanical test fixes |
| 5 | Update documentation | haiku | Simple text updates |
Phase 3 - Execution with Escalation (each step has parallel meta-judge + implementation):
Step 1: Update interfaces
Parallel dispatch: Meta-judge + Implementation
→ Judge (Opus, sadd:judge, with step 1 meta-judge spec): PASS, 4.3/5.0
Step 2: Update implementations
Parallel dispatch: Meta-judge + Implementation
→ Judge (Opus, sadd:judge, with step 2 meta-judge spec): PASS, 4.0/5.0
Step 3: Update callers (Problem Detected)
Parallel dispatch: Meta-judge + Implementation
Attempt 1: Judge FAIL, 2.5/5.0 (using step 3 meta-judge spec)
→ ISSUES: Missed 12 occurrences in legacy module
Attempt 2: Judge FAIL, 2.8/5.0 (reusing same step 3 meta-judge spec)
→ ISSUES: Still missing 4 occurrences, found new deprecated API usage
Attempt 3: Judge FAIL, 3.2/5.0 (reusing same step 3 meta-judge spec)
→ ISSUES: 2 occurrences in dynamically generated code
Attempt 4: Judge FAIL, 3.3/5.0 (reusing same step 3 meta-judge spec)
→ ISSUES: Dynamic code generation still not fully addressed
ESCALATION TO USER:
"Step 3 failed after 4 attempts. Persistent issue: Dynamic code generation
in LegacyAdapter.ts generates 'userId' at runtime.
Options: 1) Provide guidance, 2) Modify requirements, 3) Skip, 4) Abort"
User response: "Update LegacyAdapter to use string template with accountId"
Attempt 5 (with user guidance, reusing same step 3 meta-judge spec): Judge PASS, 4.1/5.0
Step 4-5: Each with parallel meta-judge + implementation, complete without issues
Total Agents: 20 (5 meta-judges + 5 implementations + 5 retries + 5 judges)
| Step Type | Implementation Model |
|---|---|
| Critical/Breaking | Opus |
| Standard | Opus |
| Long and Simple | Sonnet |
| Simple and Short | Haiku |
| Scenario | What to Pass | What to Omit |
|---|---|---|
| Interface defined in step 1 | Full interface definition | Implementation details |
| Implementation in step 2 | Key patterns, file locations | Internal logic |
| Integration in step 3 | Usage patterns, entry points | Step 2 internal details |
| Judge feedback for retry | ISSUES list, report path | Full report contents |
Keep context focused:
## Context for Next Steps
### Files Modified
- `src/dto/UserDTO.ts` (new file)
- `src/services/UserService.ts` (modified)
### Key Changes Summary
- Created UserDTO with fields: id (string), name (string), email (string), createdAt (Date)
- UserDTO includes static `fromUser(user: User): UserDTO` factory method
- Added `toDTO()` method to User class for convenience
### Decisions That Affect Later Steps
- Used class-based DTO (not interface) to enable transformation methods
- Opted for explicit mapping over automatic serialization for better control
### Warnings for Subsequent Steps
- UserDTO does NOT include password field - ensure no downstream code expects it
- The `createdAt` field is formatted as ISO string in JSON serialization
### Verification Points
- TypeScript compiles without errors
- UserDTO.fromUser() correctly maps all User properties
- Existing service tests still pass
---
VERDICT: PASS
SCORE: 4.2/5.0
ISSUES:
- None
IMPROVEMENTS:
- Consider adding input validation to fromUser() method
- Add JSDoc comments for better IDE support
---
## Detailed Evaluation
[Evidence and analysis following meta-judge specification rubrics...]
---
VERDICT: FAIL
SCORE: 2.8/5.0
ISSUES:
- Missing User->UserDTO mapping logic in getUser() method
- Return type annotation changed but actual return value still returns User object
- No null handling for optional User fields
IMPROVEMENTS:
- Add static fromUser() factory method to UserDTO
- Implement toDTO() as instance method on User class
---
Key Insight: Complex tasks with dependencies benefit from sequential execution where each step operates in a fresh context while receiving only the relevant outputs from previous steps. Per-step meta-judge evaluation specifications ensure tailored evaluation criteria specific to each step's requirements, while running in parallel with implementation for speed. External judge verification catches blind spots that self-critique misses, while the iteration loop (reusing the same step's meta-judge spec) ensures quality before proceeding. This prevents both context pollution and error propagation.