holistic-review

name	holistic-review
description	One-shot holistic referee review of the full paper. Issues are written to .review/holistic/ as append-only issue.json files.
user-invocable	true
allowed-tools	Bash, Read, Write, Edit, Glob, Grep, Agent, WebFetch

Holistic Referee Review

Run from the repo root. Requires .review/config.json and .review/parsed/ from Phase 0. Can run before, after, or concurrently with the broad sweep.

Step 1: Read the full paper

Read all parsed sections in order to build a complete picture of the paper. If a PDF is available in the repo, read that too for figures and tables.

Step 2: Write a referee report

Write a structured referee report to .review/holistic_report.md in the voice of a knowledgeable, constructive journal referee. The report should cover:

Summary (1 paragraph)

Summarize what the paper does, its main contribution, and key findings.

Overall assessment

• Importance: Is this an important question? Does the paper make a meaningful contribution?
• Novelty: What is genuinely new vs. incremental?
• Positioning: Is the paper well-positioned relative to the literature? Are key references missing?

Major concerns

Issues that would need to be addressed before publication.

Minor concerns

Issues that improve the paper but don't block publication.

Questions for the authors

Specific questions a referee would ask.

Step 3: Parse issues from the report

Extract each concern (major and minor) from the holistic report and create issue directories in .review/holistic/:

.review/holistic/
  <issue-slug>/
    issue.json

Each issue.json:

{
  "title": "<issue title>",
  "spotter": "holistic",
  "source_section": "<most relevant section file>",
  "quoted_text": "<most relevant quote from the manuscript>",
  "description": "<description from the referee report>",
  "holistic_severity": "major|minor",
  "created_at": "<ISO timestamp>"
}

Use descriptive slugs for directory names (e.g., single-llm-dependence, missing-robustness-checks).

Step 4: Commit

git add -A
git commit -m "review: holistic review — <N> issues (<M> major, <Mi> minor)"

Report: the full referee report summary, number of issues extracted.