| name | mapreduce |
| description | Fan-out tasks to multiple AI providers or agent instances in parallel, then consolidate the results into a single high-quality output. Use for parallel planning, multi-implementation code generation, and debug consensus across Claude subagents and external CLI providers. |
MapReduce Skill
Skill ID: mapreduce
Purpose: Fan-out tasks to multiple providers/agents, then consolidate results
Category: Orchestration
Overview
The MapReduce skill enables parallel task execution across multiple AI providers
or agent instances, followed by intelligent consolidation of results. This
produces higher-quality outputs by leveraging diverse model strengths and
cross-validating findings.
Architecture
┌─────────────────────────────────────────────────────────────────────────┐
│ MAIN THREAD (Orchestrator) │
│ │
│ ┌─────────────────────────────────────────────────────────────────┐ │
│ │ PHASE 1: MAP (Parallel Fan-Out) │ │
│ │ │ │
│ │ Task(worker-1) ──→ output-1.md │ │
│ │ Task(worker-2) ──→ output-2.md │ │
│ │ Task(worker-3) ──→ output-3.md │ │
│ │ bash(codex) ──→ output-codex.md │ │
│ │ bash(gemini) ──→ output-gemini.md │ │
│ └─────────────────────────────────────────────────────────────────┘ │
│ │ │
│ ▼ │
│ ┌─────────────────────────────────────────────────────────────────┐ │
│ │ PHASE 2: COLLECT (Timeout-Based) │ │
│ │ │ │
│ │ TaskOutput(worker-1, timeout=120s) │ │
│ │ TaskOutput(worker-2, timeout=120s) │ │
│ │ TaskOutput(worker-3, timeout=120s) │ │
│ │ Verify: output-codex.md, output-gemini.md exist │ │
│ └─────────────────────────────────────────────────────────────────┘ │
│ │ │
│ ▼ │
│ ┌─────────────────────────────────────────────────────────────────┐ │
│ │ PHASE 3: REDUCE (Consolidation) │ │
│ │ │ │
│ │ Task(reducer) ──→ reads all outputs ──→ consolidated.md │ │
│ └─────────────────────────────────────────────────────────────────┘ │
└─────────────────────────────────────────────────────────────────────────┘
