scaffold-reporting

name	scaffold-reporting
version	0.1.0
description	Synthesize scaffold test reports into cross-preset summaries with score aggregation, trend analysis, and Linear issue recommendations. Use after scaffold testing completes.

Scaffold Reporting

Synthesize per-preset scaffold test reports into a unified summary with cross-cutting analysis.

Workflow

Step 1: Gather Reports

Read all report.json files from the run directory. Use the manifest to locate preset directories and their report paths.

For each preset in the manifest:

• If status is completed, read report.json from the preset directory
• If status is errored, note the error but continue with available reports
• If status is pending, flag as incomplete

Step 2: Aggregate Scores

For each scoring dimension (agentReadiness, documentationCompleteness, errorClarity, setupFriction, typeCorrectness, overall), compute:

• mean: Average across all completed presets
• min: Lowest score (identify the weakest preset)
• max: Highest score (identify the strongest preset)
• stddev: Standard deviation (consistency across presets)

Step 3: Cross-Reference

Identify patterns across presets:

• Same errors appearing in multiple presets (shared dependency issues, common template bugs)
• Consistently low dimensions (systematic weakness in scaffolding)
• Common dependency warnings or resolution issues