| name | ajs-research-design |
| description | Use when defending the research design of an American Journal of Sociology (AJS) manuscript on its own methodological terms — quantitative, comparative-historical, ethnographic, network, or formal. AJS judges each kind of work by the standards of its tradition; the design must support the theoretical claim. Defends the design; it does not run the analysis. |
Research Design (ajs-research-design)
AJS is method-pluralist: it publishes leading quantitative, comparative-historical, ethnographic,
network, and formal work, and it judges each by the standards of its own tradition. The job here is
to make the design defensible to a generalist, possibly cross-method, double-blind reviewer — and to
show the design actually supports the theoretical claim from ajs-theory-building.
When to trigger
- Choosing or justifying the design before data collection or analysis
- A reader questioned identification, case selection, sampling, or evidentiary warrant
- Aligning the design with the mechanism and observable implications
- Mixed-methods work that must defend each component on its own terms
Defend the design (by tradition)
Quantitative / observational
- State the estimand and the identifying assumptions plainly; AJS rewards honesty over false
precision. Where the design is descriptive or associational, say so and theorize accordingly.
- Justify sample, measurement, and model; pre-empt confounding and selection.
Comparative-historical
- Make case selection and the comparative logic explicit (most-similar / most-different,
typical / deviant, scope of the comparison).
- Keep a clear evidentiary trail from primary sources to claims; treat sequence and conjuncture as
evidence, not decoration.
Ethnographic / interview
- Describe access, site/case selection, duration, and positionality; justify why this case bears
the theoretical weight.
- Make the link from fieldnotes/transcripts to claims legible (without exposing informants).
Network / computational
- Justify boundary specification, tie definition, and missingness; match the model (e.g., ERGM,
SAOM) to the relational question.
Formal
- Tie assumptions to the substantive setting; specify what empirical patterns would corroborate or
challenge the model.
Match design to claim
The single most common AJS reviewer objection: the design cannot bear the theoretical claim. Walk
the chain: claim → mechanism → observable implication → the design's leverage on it. If a step is
weak, tighten the claim or strengthen the design — do not overclaim.
Referee-pushback patterns by tradition (the modal AJS objection)
The most common AJS design rejection is "the design cannot bear the theoretical claim." Recurring objections by tradition; confirm method expectations against the journal's current submission guidelines.
| Referee writes… | Tradition | The AJS-appropriate fix |
|---|
| "Selecting on the outcome." | comparative-historical | add a non-outcome case or acknowledge the limit |
| "Representativeness asserted." | ethnographic | argue why this case bears the theoretical weight |
| "Identification overclaimed." | quantitative | restate as descriptive/associational and theorize it |
Calibration with a quick example (hedged)
AJS judges each tradition by its own standard, not a single template; unlike a parsimony-first sibling that privileges a clean causal estimate, it accepts a richly defended interpretive or comparative design when it bears the claim. Illustrative: an author selecting four states that all underwent revolution, then theorizing "state breakdown causes revolution," is flagged for selecting on the outcome; the fix adds two negative cases (comparable fiscal crises that did not break down) so the comparison can see the mechanism fail as well as fire. Confirm method guidance against the journal's current submission guidelines.
Execution bridge (StatsPAI / Stata MCP)
Estimate and audit the design, don't only describe it. Full map:
execution-with-mcp. AJS is general sociology with a strong theory tradition; apply the chain below to its quantitative-empirical lane.
detect_design → recommend → fit with as_handle=true → audit_result.- Observational causal claims: staggered DiD (
callaway_santanna / sun_abraham +
bacon_decomposition + honest_did_from_result); IV (effective_f_test +
anderson_rubin_ci); RDD (rdrobust + mccrary_test).
- Experiments: randomization-based inference,
romano_wolf for many-outcome
family-wise control, and mediate for mediation (not naive controlling-away).
- Sensitivity:
oster_delta / sensemakr for observational claims.
Report the effect size in interpretable units; route the full battery to the
appendix/supplement. A run end-to-end (synthetic data, real returns) is in the
JF execution walkthrough.
Anti-patterns
- Borrowing a quantitative identification template for work that is interpretive or comparative
- Case selection that quietly guarantees the result (selecting on the outcome without acknowledging it)
- Ethnography that asserts representativeness it cannot support
- Overclaiming causality from an associational design
- A design that tests something adjacent to, but not, the stated theoretical claim
- Designing only to confirm the mechanism, with no case where it could be seen to fail
Design pass for American Journal of Sociology
Treat this skill as an executable review pass, not a prose hint. First lock the social process, data leverage, causal or interpretive warrant, and theoretical payoff; then judge whether the current manuscript answers the venue's real reader: sociology reviewers who value deep theory, durable empirical leverage, and careful social-mechanism claims.
- Do the pass: Lock the unit, scope, comparison, validity threat, and minimum decisive evidence before recommending collection, analysis, or submission.
- Return a ledger: give
claim / evidence / risk / manuscript location rows, so the next agent can edit rather than rediscover the issue.
- Sibling guard: compare against ASR for broader empirical sociology, Social Forces for wider substantive range, Demography for population mechanisms; if a sibling owns the contribution, recommend re-routing before polishing format.
- Stop condition: do not give submission-ready advice until the pack's
resources/official-source-map.md has been checked for volatile rules and the manuscript has one concrete fix for the largest venue-specific risk.
Output format
【Tradition】quantitative / comparative-historical / ethnographic / network / formal / mixed
【Claim it must support】from theory-building
【Design leverage】how this design bears on the claim
【Key assumptions / threats】identification, selection, access, boundary, etc.
【Evidentiary trail】sources → claims is legible? [Y/N]
【Verdict】supports the claim / needs tightening / overclaims (fix)
【Next】ajs-data-analysis
Supplementary resources
