用 Codex 或 Claude 帮你安装 复制这段 Prompt,粘贴到 Codex、Claude 或其他助手里,让它检查 Skill 页面并帮你完成安装。
直接命令不会经过审查 Prompt;运行前请先检查来源。
npx skills add https://github.com/duc01226/EasyPlatform --skill integration-test命令会保持在同一行。复制前请横向滚动并检查完整内容。
想先保存到本地?可下载 SkillsMP 当前能够提供的文件。
[Architecture] Use when designing solution architecture across backend, frontend, deployment, monitoring, testing, and code quality.
[Utilities] Use when you need to answer technical and architectural questions.
[Content] Use when you need to brainstorm as a PO/BA — structured ideation for problem-solving, new product creation, or feature enhancement.
正在显示 SKILL.md
基于 SOC 职业分类
| name | integration-test |
| description | [Testing] Use when you need to generate or review integration tests. |
Codex compatibility note:
- Invoke repository skills with
$skill-namein Codex; this mirrored copy rewrites legacy Claude/skill-namereferences.- Task tracker mandate: BEFORE executing any workflow or skill step, create/update task tracking for all steps and keep it synchronized as progress changes.
- User-question prompts mean to ask the user directly in Codex.
- Ignore Claude-specific mode-switch instructions when they appear.
- Strict execution contract: when a user explicitly invokes a skill, execute that skill protocol as written.
- Subagent authorization: when a skill is user-invoked or AI-detected and its protocol requires subagents, that skill activation authorizes use of the required
spawn_agentsubagent(s) for that task.- Do not skip, reorder, or merge protocol steps unless the user explicitly approves the deviation first.
- For workflow skills, execute each listed child-skill step explicitly and report step-by-step evidence.
- If a required step/tool cannot run in this environment, stop and ask the user before adapting.
Codex uses static project-reference loading instead of runtime-injected project docs. When coding, planning, debugging, testing, or reviewing, open project docs explicitly using this routing.
Always read:
docs/project-config.json (project-specific paths, commands, modules, and workflow/test settings)docs/project-reference/docs-index-reference.md (routes to the full docs/project-reference/* catalog)docs/project-reference/lessons.md (always-on guardrails and anti-patterns)Missing/stale context route: If docs/project-config.json, the docs index, lessons.md, CLAUDE.md, AGENTS.md, or any task-required reference doc is missing or stale, auto-run $project-init or the narrow setup route ($project-config, $docs-init, $scan-all, $scan --target=<key>, $claude-md-init) before ordinary project-specific work. If Codex mirrors or AGENTS.md are missing/stale, ask the user to run $sync-codex; do not auto-run it.
Situation-based docs:
backend-patterns-reference.md, domain-entities-reference.md, project-structure-reference.mdfrontend-patterns-reference.md, scss-styling-guide.md, design-system/README.mddocs/specs/ pathing, or TC format: feature-spec-reference.md, spec-system-reference.md, spec-principles.mdworkflow-spec-test-code-cycle-reference.md plus the spec docs abovespec-system-reference.md and source Feature Specs under docs/specs/integration-test-reference.mde2e-test-reference.mdcode-review-rules.md plus domain docs above based on changed filesDo not read all docs blindly. Start from docs-index-reference.md, then open only relevant files for the task.
[BLOCKING] Execute skill steps in declared order. NEVER skip, reorder, or merge steps without explicit user approval. [BLOCKING] Before each step or sub-skill call, update task tracking: set
in_progresswhen step starts, setcompletedwhen step ends. [BLOCKING] Every completed/skipped step MUST include brief evidence or explicit skip reason. [BLOCKING] If Task tools are unavailable, create and maintain an equivalent step-by-step plan tracker with the same status transitions.
Goal: Generate/review integration tests using real DI (no mocks) across 5 modes (from-changes · from-prompt · review · diagnose · verify-traceability) that exercise real production paths and assert specific DB field values — so every test protects a traceable business behavior (TC), survives repeated runs without reset, and fails only when the protected intent actually breaks.
Summary:
TC-{FEATURE}-{NNN} test-spec annotation; one business TC maps to MANY tests (1:N, integration + unit), so cover with as many tests as needed — never split a TC to force 1:1, and auto-create a TC in feature-doc Section 8 only for genuinely uncovered business behavior.references/integration-test-patterns.md before writing; match local conventions (collection, base class, helpers, unique-name generators) and organize files by domain feature, never by Queries//Commands/ CQRS type.$integration-test-verify runs WITHOUT a DB reset; the in-skill review/verify modes are lightweight inline passes, distinct from the heavier standalone $integration-test-review and $integration-test-verify skills.Workflow: Detect mode → Find targets → Gather context → Execute → Report
Key Rules:
references/integration-test-patterns.md before writingQueries/ or Commands/ folders$integration-test-verify runs without DB resetPrerequisites — MUST ATTENTION READ before executing:
references/integration-test-patterns.md— canonical test templates: collection attributes, base class usage, TC annotation format, async polling helpers, unique name generators, DB assertion patterns. Read before writing ANY test.
docs/specs/— existing TCs by module: read to verify test-to-spec traceability and get TC IDs before generating.
references/integration-test-patterns.md — canonical test templates (MUST READ before writing any test)docs/project-reference/domain-entities-reference.md — domain entity catalog, relationships, cross-service syncdocs/specs/ — existing TCs by module (read before generating tests; verify test-to-spec traceability)CRITICAL: Search existing patterns FIRST. Before generating ANY test, grep existing integration test files in same service. Read ≥1 existing test file to match conventions (namespace, usings, collection name, base class, helper usage). NEVER generate tests contradicting established codebase patterns.
CRITICAL: NO Smoke/Fake/Useless Tests. Every test MUST execute actual commands/handlers and verify DB data state. NO DI-resolution-only tests. NO exception-check-only tests. Before writing assertions: READ handler/entity/event source — understand WHAT fields change, WHAT entities created/updated/deleted, WHAT event handlers fire. Assert specific field values.
CRITICAL: Async Polling for ALL Data Assertions. ALWAYS wrap data state assertions in async polling/retry helper. DEFAULT for ALL data verification — not just async handlers. Data persistence may be delayed by event handlers, message bus consumers, background jobs, DB write latency. Rule: If asserting data in DB → use async polling. No exceptions.
For test specifications and test case generation from PBIs, use
$spec [mode=tests]skill instead.
Spec-Loop Discipline (property + mutation bar). Where a rule is universal — a
[HARD]§4 rule or a §5 invariant that holds for ALL inputs, not just one example — generate a property/metamorphic test (seereferences/integration-test-patterns.md→ Pattern 9) plus a boundary counter-case, and trace each to a §8 Invariant/Property TC (not just an example-scenario TC). The assertion-quality bar is MUTATION-KILL, not line-coverage %: a mutant that survives on the covered core-logic = a missing invariant → write the killing test. (Example-only scenarios stay valid for non-universal behaviors; this is additive for the universal ones.)
External Memory: Complex/lengthy work → write findings to
plans/reports/— prevents context loss.
Evidence Gate: MANDATORY IMPORTANT MUST ATTENTION — every claim requires
file:lineproof or traced evidence with confidence percentage (>80% act, <80% verify first).
The success metric of every coding decision is future change cost. DRY, SRP, abstraction, design patterns, naming, layering, tests — every technique exists to serve one goal: making the next change cheaper.
When evaluating code, a refactor, a test, or an abstraction, ask: does this make the next change cheaper or more expensive?
Apply this lens before invoking any specific rule, pattern, or checklist below — if a downstream rule would raise change cost, this principle wins.
Before implementation, search codebase for patterns:
IntegrationTest, TestFixture, TestUserContext, IntegrationTestBaseMANDATORY IMPORTANT MUST ATTENTION plan task to READ
integration-test-reference.mdfor project-specific patterns and code examples. If not found, continue with search-based discovery.
Workflow:
Key Rules:
references/integration-test-patterns.md before writing any testOrders/OrderCommandIntegrationTests.*). NEVER create Queries/ or Commands/ folder.// TC-{FEATURE}-{NNN}: Description comment + test-spec annotation — before method, outside body. Many test methods MAY carry the same TC (one business TC → many tests across components/services); the test-spec annotation is the join key, so cover a TC with as many technical tests as the implementation needs without inventing extra TCs.$spec [mode=tests] firstALWAYS create and execute tasks in this exact order:
FIRST: Verify/upsert test specs in feature docs
docs/specs/{App}/README.{Feature}.md) for target domainTC-{FEATURE}-{NNN} existsTestSpec annotationMIDDLE: Implement integration tests
FINAL: Verify traceability (cardinality: 1 TC : N tests)
TC-{FEATURE}-{NNN} in feature doc Section 8 / specs docTestSpec annotation); every doc TC → ≥1 covering test method. One TC may be covered by many test methods (integration + unit, across components/services) — that is the expected one-to-many shape. NEVER require one test per TC, and NEVER split/technicalize a business TC to make tests map 1:1 (breaks the spec's business/user-story orientation, M1/M5 — see tc-format.md → TC ↔ Test Code Cardinality).TestSpec TC is absent from §8; doc TCs with zero covering tests. (Many tests sharing one TC is NOT an orphan and NOT a duplicate.)IntegrationTest field in feature doc TCs with the covering tests — {File}::{MethodName} comma-separated on one line, or a test-filter expression when the set is large (the field is representative; the annotation in code is authoritative). The covering set MAY include unit tests, not only integration tests.| Module | Abbreviation | Test Folder |
|---|---|---|
| Order Management | OM | Orders/ |
| Inventory | INV | Inventory/ |
| User Profiles | UP | UserProfiles/ |
| Notification Management | NM | Notifications/ |
| Report Generation | RG | Reports/ |
| Feedback | FB | Feedback/ |
| Background Jobs | BJ | — |
Creating new TC-{FEATURE}-{NNN} codes:
docs/specs/{App}/README.{Feature}.md has existing codes. New codes must not collide.Args = command/query name (e.g., "$integration-test CreateOrderCommand")
→ FROM-PROMPT mode: generate tests for the specified command/query
No args (e.g., "$integration-test")
→ FROM-CHANGES mode: detect changed command/query files from git
Args = "review" (e.g., "$integration-test review Orders")
→ REVIEW mode: audit existing test quality, find flaky patterns, check best practices
Args = "diagnose" (e.g., "$integration-test diagnose OrderCommandIntegrationTests")
→ DIAGNOSE mode: analyze why tests fail — determine test bug vs code bug
Args = "verify" (e.g., "$integration-test verify {Service}")
→ VERIFY-TRACEABILITY mode: check test code matches specs and feature docs
Modes vs. sibling skills (name-collision note). The
reviewandverifymodes above are lightweight branches inside this skill — quick, inline audits run during generation. They are NOT the same as the standalone skills$integration-test-review(deep test-quality review) and$integration-test-verify(full spec-traceability verification), which are separate, heavier workflow steps. When the refactor workflow sequences$integration-test → $integration-test-review → $integration-test-verify, those are the standalone skills, not these in-skill modes. Use a mode for a fast pass mid-generation; invoke the sibling skill for a thorough, standalone gate.
Run via Bash tool:
git diff --name-only; git diff --cached --name-only
Filter for command/query files using project naming conventions (e.g., *Command.*, *Query.*). Path patterns from docs/project-config.json → modules or backendServices. Extract service from path:
| Path pattern | Service | Test project |
|---|---|---|
Per docs/project-config.json service path pattern | {Service} | {Service}.IntegrationTests (or project equivalent) |
Search codebase for existing *.IntegrationTests.* projects to find correct mapping.
If no test project exists: inform user "No integration test project for {service}. See CLAUDE.md Integration Testing section to create one."
If test file already exists: ask user overwrite or skip.
User specifies command/query name. Use Grep tool (NOT bash grep):
Grep pattern="{CommandName}" path="{configured-source-root}" glob="{configured-source-glob}"
For each target, read in parallel:
{Service}.IntegrationTests/**/*IntegrationTests.*, read ≥1 for conventions (collection/suite name, test annotations, namespace/imports, base class)class.*ServiceIntegrationTestBasereferences/integration-test-patterns.md — canonical templates (adapt {Service} placeholders)For each target domain, read:
docs/specs/{App}/README.{Feature}.md Section 8 (primary source)Build mapping: test case description → TC code (e.g., "create valid order" → TC-OM-001).
$spec [mode=tests] first.File path: {project-test-dir}/{Service}.IntegrationTests/{Domain}/{CommandName}IntegrationTests{ext} (adapt path/extension per docs/project-config.json → integrationTestVerify.testProjectPattern)
Folder = domain feature.
{Domain}= business domain (Orders, Inventory, Notifications, UserProfiles), NOT CQRS type. Command and query tests for same domain live in same folder.
Structure: adapt file layout, imports, fixture setup, assertion style, and test markers from existing tests in the configured test project.
namespace {Service}.IntegrationTests.{Domain};
[Collection({Service}IntegrationTestCollection.Name)] [Trait("Category", "Command")] // or "Query" public class {CommandName}IntegrationTests : {Service}ServiceIntegrationTestBase { // Minimum 3 tests: happy path, validation failure, DB state verification }
**Test method naming:** `{CommandName}_When{Condition}_Should{Expectation}`
**Required patterns per command type:**
| Command type | Required tests |
| ------------ | -------------------------------------------------- |
| Save/Create | Happy path + validation failure + DB state |
| Update | Create-then-update + verify updated fields in DB |
| Delete | Create-then-delete + `AssertEntityDeletedAsync` |
| Query | Filter returns results + pagination + empty result |
| **Owns a [HARD] §4 rule or §5 invariant** (orthogonal to the rows above — applies to the same command/query) | **+ Pattern 9 property/metamorphic test** tied to a §8 Invariant/Property TC: the example tests above guard fixed points; the property test guards the rule across its whole input domain (see `references/integration-test-patterns.md` → Pattern 9). FORCED, not optional — a `>`/`>=` flip on the invariant line must fail an assertion. |
> **[FORCED BRANCH — property apparatus]** Pattern 9 is not a "nice-to-have reference". For ANY command/query whose handler enforces a `[HARD]` §4 business rule or a §5 entity invariant, the example-based rows are NOT sufficient on their own — generate the Pattern 9 property test alongside them, carrying the `TestSpec` annotation of the §8 Invariant/Property TC (decade `071–079`). This is the test-side mirror of the spec-side invariant-coverage gate (`spec [mode=tests]` → property TC count ≥ count([HARD] BR) + count(§5 invariants)). Skipping it = a fakeable, over-fitted suite that passes while the rule can be broken across the unenumerated space.
## Step 4: Verify
Build test project via project's build tool (see `$integration-test-verify` for config-driven build).
MUST ATTENTION verify ALL of the following:
- Test collection/group attribute present with correct collection name
- Test category annotation present
- All string test data uses project's unique name generator
- User context created via project's user context factory
- DB assertions use project's entity assertion helpers with async polling
- No mocks — real DI only
- Every test method has `// TC-{FEATURE}-{NNN}: Description` comment + test-spec annotation
## Example Files to Study
Search codebase for existing integration test files:
```bash
find . -name "*IntegrationTests.*" -type f
find . -name "*IntegrationTestBase.*" -type f
find . -name "*IntegrationTestFixture.*" -type f
| Pattern | Shows |
|---|---|
{Service}.IntegrationTests/{Domain}/*CommandIntegrationTests.* | Create + update + validation |
{Service}.IntegrationTests/{Domain}/*QueryIntegrationTests.* | Query with create-then-query |
{Service}.IntegrationTests/{Domain}/Delete*IntegrationTests.* | Delete + cascade |
{Service}.IntegrationTests/{Service}ServiceIntegrationTestBase.* | Service base class pattern |
Case: Generate tests from existing test specs (feature docs Section 8)
$integration-test CreateOrderCommand
→ Reads Section 8 TCs, generates test file with TC annotations
Case: Generate tests from git changes (default)
$integration-test
→ Detects changed command/query files, checks Section 8 for matching TCs, generates tests
Case: Generate tests after $spec [mode=tests] created new TCs
$spec [mode=tests] → $integration-test
→ spec [mode=tests] writes TCs to Section 8, then integration-test generates tests from those TCs
Case: Review existing tests for quality
$integration-test review Orders
→ Audits test quality, finds flaky patterns, checks best practices
Case: Diagnose test failures
$integration-test diagnose OrderCommandIntegrationTests
→ Analyzes failures, determines test bug vs code bug
Case: Verify test-spec traceability
$integration-test verify {Service}
→ Checks test code matches specs and feature docs bidirectionally
Mode = REVIEW: audit existing integration tests for quality, flaky patterns, best practices.
| Input type | Sub-agent | Why |
|---|---|---|
| Test file quality audit | integration-tester | Purpose-built for spec generation, TC traceability, and test patterns — catches integration-specific issues code-reviewer misses |
| Security-sensitive test data (PII, auth fixtures) | security-auditor | Detects PII leakage in test fixtures |
MANDATORY: Integration test REVIEW mode spawns
integration-testersub-agent (agent_type: "integration-tester"), NOTcode-reviewer. Rationale:integration-testerspecializes in test spec generation, TC traceability, CQRS test patterns, async-polling / eventual-consistency assertion correctness, and cross-service integration context — areascode-reviewerdoes not cover at depth.
Fresh Eyes Protocol: Run Round 1 inline. If findings are LOW confidence or contradictory → spawn fresh integration-tester sub-agent (zero memory of Round 1) for Round 2. Main agent reads report, NEVER filters findings. Max 2 rounds, then escalate.
{Service}.IntegrationTests/{Domain}/**/*IntegrationTests.*Dimension 1: Reliability — Think: What causes intermittent failures?
Thread.Sleep(), Task.Delay() instead of condition-based pollingDateTime.Now without time abstractionDimension 2: Assertion Value — Think: Does the test actually verify anything?
exception.Should().BeNull() alone → HIGH severityDimension 3: Conventions — Think: Does test follow project patterns?
Dimension 4: Code Quality — Think: Maintainability and isolation?
{Action}_When{Condition}_Should{Expectation}# Integration Test Quality Report — {Domain}
## Summary
- Tests scanned: {N}
- Issues found: {N} (HIGH: {n}, MEDIUM: {n}, LOW: {n})
- Overall quality: {GOOD|NEEDS_WORK|CRITICAL}
## HIGH Severity Issues (Flaky Risk)
| Test | Issue | Fix |
| ------------ | ------------------------------------------------ | -------------------------------------- |
| {MethodName} | DB assertion without polling after async handler | Wrap in project's async polling helper |
## MEDIUM Severity Issues (Best Practice)
| Test | Issue | Fix |
| ---- | ----- | --- |
## LOW Severity Issues (Style)
| Test | Issue | Fix |
| ---- | ----- | --- |
## Recommendations
1. {Prioritized fix suggestions}
Mode = DIAGNOSE: analyze failing tests to determine test bug vs application code bug.
Test fails
├── Compilation error?
│ ├── Missing type/method → Code changed, test not updated → TEST BUG
│ └── Wrong import/namespace → TEST BUG
├── Timeout/hang?
│ ├── Missing async/await → TEST BUG
│ ├── Deadlock in handler → CODE BUG
│ └── Infrastructure down → INFRA ISSUE
├── Assertion failure?
│ ├── Expected value wrong?
│ │ ├── Test hardcoded old behavior → TEST BUG
│ │ └── Business logic changed → CODE BUG (if unintended) or TEST BUG (if intended change)
│ ├── Null/empty result?
│ │ ├── Entity not found → Check if create step succeeded → TEST BUG (setup) or CODE BUG (handler)
│ │ └── Query returns empty → Check filters/predicates → CODE BUG
│ ├── Intermittent (passes sometimes)?
│ │ ├── Async assertion without polling → TEST BUG (add async polling/retry)
│ │ ├── Non-unique test data collision → TEST BUG (use unique name generator)
│ │ └── Race condition in handler → CODE BUG
│ └── Wrong count/order?
│ ├── Test data leak from other tests → TEST BUG (isolation)
│ └── Logic error in query → CODE BUG
├── Validation error (expected success)?
│ ├── Test sends invalid data → TEST BUG
│ └── Validation rule too strict → CODE BUG
└── Exception thrown?
├── Known exception type in handler → CODE BUG
└── DI/config error → INFRA ISSUE
# Test Failure Diagnosis — {TestClass}
## Failing Tests
| Test Method | Error Type | Root Cause | Classification |
| ----------- | ----------------- | ------------- | --------------------------- |
| {Method} | {AssertionFailed} | {Description} | TEST BUG / CODE BUG / INFRA |
## Detailed Analysis
### {MethodName}
**Error:** {error message}
**Expected:** {what test expected}
**Actual:** {what happened}
**Root Cause:** {explanation with code evidence}
**Classification:** TEST BUG | CODE BUG | INFRA ISSUE
**Evidence:** `{file}:{line}` — {what the code does}
**Recommended Fix:** {specific fix with code location}
## Summary
- Test bugs: {N} — fix in test code
- Code bugs: {N} — fix in application code
- Infra issues: {N} — fix in configuration/environment
Mode = VERIFY: bidirectional traceability check between test code, test specs, feature docs.
| Scenario | Likely Correct Source | Action |
|---|---|---|
| Test passes, spec describes different behavior | Adjudication required | Compare against canonical product/spec intent before changing anything |
| Test fails, spec describes expected behavior | Spec, unless spec intent is disproved | Update test to match intended spec behavior |
| Test exists, no spec | Adjudication required | Create spec from test only after confirming the test protects intent |
| Spec exists, no test | Spec | Generate test from spec |
| Test and spec agree, but code behaves differently | Spec, unless both are stale | Fix code or update spec+test after intent adjudication |
Rule: Passing code or tests NEVER automatically outrank canonical product/spec intent. NEVER update spec, test, or code on a behavior-changing mismatch until it reaches adjudication-required status with explicit evidence. — why: a green test can encode a regression, so code agreement alone cannot ratify a spec change.
MUST ATTENTION verify ALL of the following:
Status: Untested)docs/specs/ dashboard is in sync with feature doc Section 8# Traceability Report — {Service}
## Summary
- TCs in feature docs: {N}
- Test methods with TC annotations: {N}
- Fully traced (both directions): {N}
- Orphaned tests (no matching TC): {N}
- Orphaned TCs (no matching test): {N}
- Mismatched behavior: {N}
## Traceability Matrix
| TC ID | Feature Doc? | Test Code? | Dashboard? | Status |
| --------- | ------------ | ---------- | ---------- | ------------ |
| TC-OM-001 | ✅ | ✅ | ✅ | Traced |
| TC-OM-005 | ✅ | ❌ | ✅ | Missing test |
| TC-OM-010 | ❌ | ✅ | ❌ | Missing spec |
## Orphaned Tests (no matching TC in docs)
| Test File | Method | Annotation | Action |
| --------- | -------- | ---------- | ------------------------ |
| {file} | {method} | TC-OM-010 | Create TC in feature doc |
## Orphaned TCs (no matching test)
| TC ID | Doc Location | Priority | Action |
| --------- | ------------ | -------- | ----------------------------------- |
| TC-OM-005 | Section 8 | P0 | Generate test via $integration-test |
## Behavior Mismatches
| TC ID | Doc Says | Test Does | Correct Source | Action |
| ----- | -------- | --------- | -------------- | ------ |
## Recommendations
1. {Prioritized actions}
| Pattern | When to Use | Example |
|---|---|---|
| Per-test inline | Simple tests, unique data | var order = new CreateOrderCommand { Name = UniqueName() } |
| Factory methods | Repeated entity creation | TestDataFactory.CreateValidOrder() |
| Builder pattern | Complex entities with many fields | new OrderBuilder().WithStatus(Active).WithItems(3).Build() |
| Shared fixture | Reference data needed by all tests | CollectionFixture.SeedReferenceData() |
Rules:
MANDATORY IMPORTANT MUST ATTENTION — NO EXCEPTIONS: NOT in workflow? a direct user question — do NOT decide complexity yourself. User decides:
workflow-write-integration-testworkflow (Recommended) — scout → investigate → spec [mode=tests] → why-review → review-artifact --type=spec-tests → integration-test → integration-test-review → integration-test-verify → spec [mode=sync] → docs-update → workflow-end → watzup$integration-testdirectly — standalone
IMPORTANT MUST ATTENTION: After generating/modifying integration tests, MUST:
- Run tests:
$integration-test-verify(readsquickRunCommandfromdocs/project-config.json)- If tests fail: Diagnose root cause — (a) wrong test setup/assertions → fix test, or (b) service bug → report as finding
- NEVER mark done until tests pass. Unrun tests have zero value.
- Iterate: Fix → rerun → verify until all pass or failures confirmed as service bugs
MANDATORY IMPORTANT MUST ATTENTION — NO EXCEPTIONS after completing, use a direct user question to present:
| Skill | Relationship | When to Call |
|---|---|---|
$spec [mode=tests] | Producer — TCs in feature doc Section 8 are the source for test generation | Must run spec [mode=tests] before integration-test (CREATE or UPDATE mode). TCs must exist before generating tests. |
$review-artifact --type=spec-tests | Upstream reviewer — validates TC quality before test generation | Run before integration-test to ensure TCs have real assertion value |
$spec [mode=sync] | Sync — reconciles §8 TCs ↔ integration test code after tests are linked | Run after integration-test to update the §8 IntegrationTest: fields with the covering test links |
$spec | TC host — Section 8 of feature doc is where TCs live | If feature doc is missing or Section 8 is empty → run $spec first |
$spec-index | Derived index — regenerable navigation catalog over the Feature Specs (never a source of truth) | After §8 changes, to refresh the bucket INDEX.md TC counts |
$integration-test-review | Reviewer — 7-gate quality audit of generated tests + change coverage | Always call after generating integration tests |
$integration-test-verify | Runner — executes tests and reports pass/fail | Always call after integration-test-review clears |
$docs-update | Orchestrator — calls spec [mode=sync] (Phase 4) with test traceability | Run for full doc sync after integration test files updated |
When called outside a workflow, follow this chain to complete the integration test authoring cycle.
integration-test (you are here)
│
├─ PREREQUISITE: TCs must exist in feature doc Section 8
│ [REQUIRED] Verify: docs/specs/{Bucket}/README.{Feature}.md Section 8 has TC-{FEATURE}-{NNN} entries
│ If empty → run $spec [mode=tests] [CREATE mode] first
│
├─ [REQUIRED] → $integration-test-review
│ 7-gate quality audit: assertion value, data state, repeatability, domain logic, traceability, three-way sync, change coverage.
│ Never skip — Gate 6 (three-way sync) is the only place where spec/code/test conflicts surface,
│ and Gate 7 (change coverage) is the only place where untested changed behavior surfaces.
│
├─ [REQUIRED] → $integration-test-verify
│ Runs tests and reports pass/fail counts. Never mark complete without real runner output.
│
├─ [REQUIRED] → $spec [mode=sync]
│ Updates the §8 TCs' IntegrationTest: file::method traceability links.
│
├─ [RECOMMENDED] → $docs-update
│ Updates feature doc evidence fields and version history if test coverage changed materially.
│
└─ [RECOMMENDED] → $review-artifact --type=spec-tests
Re-run if integration-test-review (Gate 6) flagged TC issues requiring TC edits.
### Mode-Specific Chains
| Mode | Pre-step | Post-step |
|------|---------|-----------|
| from-changes | verify TCs updated (run $spec [mode=tests] UPDATE first) | $integration-test-review → /verify → /sync |
| from-prompt | confirm TC exists for target feature | $integration-test-review → /verify → /sync |
| review | N/A (read-only) | report findings → $spec [mode=tests] UPDATE if TCs need fixes |
| diagnose | run $test to see failures first | fix identified issue → re-run $integration-test-verify |
| verify-traceability | N/A (read-only) | if orphaned TCs: $spec [mode=tests] UPDATE → $integration-test [from-prompt] |
[IMPORTANT] task tracking — break ALL work into small tasks BEFORE starting. NEVER skip task creation.
Source/test drift check. For coding, fix, debug, investigation, test, or review work: when source behavior changes, inspect affected unit/integration/E2E tests and decide from evidence whether tests should change to match intended behavior or the source change is an unintended bug to fix. Do not write tests for migration code; schema/data migrations are one-time execution paths, not core application logic.
AI Mistake Prevention — Failure modes to avoid on every task:
Re-read files after context changes. Context compaction, resume, or long-running work can make memory stale; verify current files before acting. Verify generated content against source evidence. AI hallucinates APIs, names, claims, and document facts. Check the relevant source before documenting or referencing. Check downstream references before deleting or renaming. Removing an artifact can stale docs, generated mirrors, configs, and callers; map references first. Trace the full impact chain after edits. Changing a definition can miss derived outputs and consumers. Follow the affected chain before declaring done. Verify ALL affected outputs, not just the first. One green check is not all green checks; validate every output surface the change can affect. Assume existing values are intentional — ask WHY before changing. Before changing a constant, limit, flag, wording, or pattern, read nearby context and history. Surface ambiguity before acting — don't pick silently. Multiple valid interpretations require an explicit question or stated assumption with risk. Keep shared guidance role-relevant. Universal guidance must help every receiving skill or agent; code-specific obligations belong only in code-specific protocols.
Critical Thinking Mindset — Apply critical thinking, sequential thinking. Every claim needs traced proof, confidence >80% to act. Anti-hallucination: Never present guess as fact — cite sources for every claim, admit uncertainty freely, self-check output for errors, cross-reference independently, stay skeptical of own confidence — certainty without evidence root of all hallucination.
Understand Code First — HARD-GATE: Do NOT write, plan, or fix until you READ existing code.
- Search 3+ similar patterns (
grep/glob) — citefile:lineevidence- Read existing files in target area — understand structure, base classes, conventions
- Run
python .claude/scripts/code_graph trace <file> --direction both --jsonwhen.code-graph/graph.dbexists- Map dependencies via
connectionsorcallers_of— know what depends on your target- Write investigation to
.ai/workspace/analysis/for non-trivial tasks (3+ files)- Re-read analysis file before implementing — never work from memory alone. — why: long context drifts from the file; the file is ground truth
- NEVER invent new patterns when existing ones work — match exactly or document deviation. — why: divergent patterns fragment the codebase and slow every future reader
BLOCKED until:
- [ ]Read target files- [ ]Grep 3+ patterns- [ ]Graph trace (if graph.db exists)- [ ]Assumptions verified with evidence
Graph Impact Analysis — When
.code-graph/graph.dbexists, runblast-radius --jsonto detect ALL files affected by changes (7 edge types: CALLS, MESSAGE_BUS, API_ENDPOINT, TRIGGERS_EVENT, PRODUCES_EVENT, TRIGGERS_COMMAND_EVENT, INHERITS). Compute gap: impacted_files - changed_files = potentially stale files. Risk: <5 Low, 5-20 Medium, >20 High. Usetrace --direction downstreamfor deep chains on high-impact files.
Infinitely Repeatable Tests — Tests MUST run N times without failure. Like manual QC — run the suite 100 times, each run just adds more data. Verification is only PASS after the relevant suite/project passes 3 consecutive runs without database reset.
- Unique data per run: Use the project's unique ID generator for ALL entity IDs created in tests. NEVER hardcode IDs.
- Additive only: Tests create data, never delete/reset. Prior test runs MUST NOT interfere with current run.
- No schema rollback dependency: Tests work with current schema only. Never rely on schema rollback or migration reversals.
- Idempotent seeders: Fixture-level seeders use create-if-missing pattern (check existence before insert). Test-level data uses unique IDs per execution.
- No cleanup required: No teardown, no database reset between runs. Each test is isolated by unique seed data, not by cleanup.
- Unique names/codes: When entities require unique names/codes, append a unique suffix using the project's ID generator.
- Migration code excluded: Do not write tests for migration code. Schema/data migrations are one-time execution paths, not core application logic.
Red Flag Stop Conditions — STOP and escalate to user via ask the user directly when:
- Confidence drops below 60% on any critical decision
- Changes would affect >20 files (blast radius too large)
- Cross-service boundary is being crossed
- Security-sensitive code (auth, crypto, PII handling)
- Breaking change detected (interface, API contract, DB schema)
- Test coverage would decrease after changes
- Approach requires technology/pattern not in the project
NEVER proceed past a red flag without explicit user approval.
Rationalization Prevention — AI skips steps via these evasions. Recognize and reject:
Evasion Rebuttal "Too simple for a plan" Simple + wrong assumptions = wasted time. Plan anyway. "I'll test after" RED before GREEN. Write/verify test first. "Already searched" Show grep evidence with file:line. No proof = no search."Just do it" Still need task tracking. Skip depth, never skip tracking. "Just a small fix" Small fix in wrong location cascades. Verify file:line first. "Code is self-explanatory" Future readers need evidence trail. Document anyway. "Combine steps to save time" Combined steps dilute focus. Each step has distinct purpose.
Incremental Result Persistence — MANDATORY for all sub-agents or heavy inline steps processing >3 files.
- Before starting: Create report file
plans/reports/{skill}-{date}-{slug}.md- After each file/section reviewed: Append findings to report immediately — never hold in memory
- Return to main agent: Summary only (per SYNC:subagent-return-contract) with
Full report:path- Main agent: Reads report file only when resolving specific blockers
Why: Context cutoff mid-execution loses ALL in-memory findings. Each disk write survives compaction. Partial results are better than no results.
Report naming:
plans/reports/{skill-name}-{YYMMDD}-{HHmm}-{slug}.md
Sub-Agent Return Contract — When this skill spawns a sub-agent, the sub-agent MUST return ONLY this structure. Main agent reads only this summary — NEVER requests full sub-agent output inline.
## Sub-Agent Result: [skill-name] Status: ✅ PASS | ⚠️ PARTIAL | ❌ FAIL Confidence: [0-100]% ### Findings (Critical/High only — max 10 bullets) - [severity] [file:line] [finding] ### Actions Taken - [file changed] [what changed] ### Blockers (if any) - [blocker description] Full report: plans/reports/[skill-name]-[date]-[slug].mdMain agent reads
Full reportfile ONLY when: (a) resolving a specific blocker, or (b) building a fix plan. Sub-agent writes full report incrementally (per SYNC:incremental-persistence) — not held in memory.Context budget — the return payload is a SUMMARY, not a transcript: ≤10 finding bullets, no raw file contents / full diffs / verbatim logs inline, no re-pasted source. Everything beyond the summary lives in the
Full reporton disk. A sub-agent that would exceed the summary shape MUST write the detail to its report and return only the pointer — the orchestrator's context is the scarce resource the whole map-reduce protects.
Sub-Agent Selection — Full routing contract:
.claude/skills/shared/sub-agent-selection-guide.mdRule: Route specialized domains (architecture, security, performance, DB, E2E, integration-test, git) to the matching specialist agent (see guide above) — NEVER usecode-reviewerfor these. — why:code-reviewerlacks each domain's checklist, so specialized issues slip through.
Nested Task Expansion Contract — For workflow-step invocation, the
[Workflow] ...row is only a parent container; the child skill still creates visible phase tasks.
- Call the current task list first. If a matching active parent workflow row exists, set
nested=trueand recordparentTaskId; otherwise run standalone.- Create one task per declared phase before phase work. When nested, prefix subjects
[N.M] $skill-name — phase.- When nested, link the parent with
TaskUpdate(parentTaskId, addBlockedBy: [childIds]).- Orchestrators must pre-expand a child skill's phase list and link the workflow row before invoking that child skill or sub-agent.
- Mark exactly one child
in_progressbefore work andcompletedimmediately after evidence is written.- Complete the parent only after all child tasks are completed or explicitly cancelled with reason.
Blocked until: the current task list done, child phases created, parent linked when nested, first child marked
in_progress.
Project Reference Docs Gate — Run after task-tracking bootstrap and before target/source file reads, grep, edits, or analysis. Project docs override generic framework assumptions.
- Identify scope: file types, domain area, and operation.
- Required docs by trigger: always
docs/project-reference/lessons.md; doc lookupdocs-index-reference.md; reviewcode-review-rules.md; backend/CQRS/APIbackend-patterns-reference.md; domain/entitydomain-entities-reference.md; frontend/UIfrontend-patterns-reference.md; styles/designscss-styling-guide.md+design-system/design-system-canonical.md; integration testsintegration-test-reference.md; E2Ee2e-test-reference.md; feature docs/specsfeature-spec-reference.md+spec-system-reference.md+spec-principles.md; behavior/public-contract/spec-test-code syncworkflow-spec-test-code-cycle-reference.md; derived spec index/ERD/reimplementation guidesspec-system-reference.md+ source Feature Specs underdocs/specs/; architecture/new areaproject-structure-reference.md.- Read every required doc. If
docs/project-config.json, the docs index,lessons.md,CLAUDE.md,AGENTS.md, or any task-required reference doc is missing or stale, auto-run$project-initor the narrow lower-level route ($project-config,$docs-init,$scan-all,$scan --target=<key>,$claude-md-init) before ordinary project-specific work. If Codex mirrors orAGENTS.mdare missing/stale, ask the user to run$sync-codex; do not auto-run it.- Before target work, state:
Reference docs read: ... | Not applicable: ....Ready when: scope evaluated, required docs checked/read or setup route completed,
lessons.mdconfirmed, citation emitted.
Task Tracking & External Report Persistence — Bootstrap this before execution; then run project-reference doc prefetch before target/source work.
- Create a small task breakdown before target file reads, grep, edits, or analysis. On context loss, inspect the current task list first.
- Mark one task
in_progressbefore work andcompletedimmediately after evidence; never batch transitions.- For plan/review work, create
plans/reports/{skill}-{YYMMDD}-{HHmm}-{slug}.mdbefore first finding.- Append findings after each file/section/decision and synthesize from the report file at the end.
- Final output cites
Full report: plans/reports/{filename}.Blocked until: task breakdown exists, report path declared for plan/review work, first finding persisted before the next finding.
file:line.
file:line evidence for every claim. Confidence >80% to act, <60% = do NOT recommend.
blast-radius when graph.db exists. Flag impacted files NOT in changeset as potentially stale.
MUST ATTENTION apply critical + sequential thinking — every claim needs appropriate traced evidence (file:line for repo/code claims; source URL or artifact section for research, product, content, and docs claims); confidence >80% to act, <60% DO NOT recommend. Anti-hallucination: never present guess as fact, admit uncertainty freely, cross-reference independently, stay skeptical of own confidence.
MUST ATTENTION apply AI mistake prevention — verify generated content against evidence, trace downstream references before deleting or renaming, verify all affected outputs, re-read files after context loss, and surface ambiguity before acting.
plans/reports/ incrementally and synthesize from disk.Reference docs read: ....lessons.md; project conventions override generic defaults.$project-init or the narrow lower-level route before ordinary project-specific work.[N.M] $skill-name — phase prefixes and one-in_progress discipline.IMPORTANT MUST ATTENTION follow declared step order for this skill; NEVER skip, reorder, or merge steps without explicit user approval
IMPORTANT MUST ATTENTION for every step/sub-skill call: set in_progress before execution, set completed after execution
IMPORTANT MUST ATTENTION every skipped step MUST include explicit reason; every completed step MUST include concise evidence
IMPORTANT MUST ATTENTION if Task tools unavailable, maintain an equivalent step-by-step plan tracker with synchronized statuses
IMPORTANT MUST ATTENTION Goal: Produce integration tests that exercise real production paths and assert specific DB field values — so every test protects a traceable business behavior (TC), survives repeated runs without reset, and fails only when the protected intent actually breaks.
Protocols in force (concise digest of the SYNC/shared blocks this skill carries) — MUST ATTENTION each canonical body below is in force; this digest is the signpost, NEVER the substitute:
Source/Test Drift Check: on source change, adjudicate whether tests or source is wrong.
AI Mistake Prevention: verify generated content against evidence, trace downstream references, verify all affected outputs, re-read after context loss, surface ambiguity.
Critical Thinking: every claim needs traced proof; never present a guess as fact.
Understand Code First: read existing code and grep 3+ patterns before writing.
Graph Impact Analysis: run blast-radius when graph.db exists; flag stale impacted files.
Repeatable Test Principle: unique data, additive-only, no reset — pass 3 consecutive runs.
Red Flag Stop Conditions: escalate on low confidence, large blast radius, breaking change.
Rationalization Prevention: reject step-skipping evasions; show grep evidence, plan anyway.
Incremental Persistence: persist findings to plans/reports/ after each file, never in memory.
Sub-Agent Return Contract: sub-agents return only the summary shape, detail on disk.
Sub-Agent Selection: route specialized domains to matching specialists, never code-reviewer.
Nested Task Creation: child skills expand visible phase tasks and link the parent.
Project Reference Docs Guide: read required project-reference docs (always lessons.md) before target work.
Task Tracking & External Report: bootstrap task breakdown, transition one task at a time.
MANDATORY IMPORTANT MUST ATTENTION NEVER write smoke-only tests — instead read handler/entity/event source, assert specific changed field values — why: DI-resolution / exception-null-only tests pass while the behavior is broken
MANDATORY IMPORTANT MUST ATTENTION ALWAYS use async polling for EVERY DB assertion — no exceptions, not just async handlers — why: event handlers, message-bus consumers, background jobs, write latency delay persistence
MANDATORY IMPORTANT MUST ATTENTION NEVER fabricate state by direct repository writes — instead drive state through real command/query/seeder paths or valid seeded fixtures — why: shortcut data creates invalid state the suite then certifies
Anti-Rationalization:
| Evasion | Rebuttal |
|---|---|
| "Test is simple, skip TC lookup" | TC traceability = test value. Skip = untraceable test. |
| "Async polling not needed here" | ALL DB assertions need polling. Handler type irrelevant. |
| "Already searched patterns" | Show file:line evidence. No proof = no search. |
| "Smoke test is fine for now" | Smoke-only FORBIDDEN. Assert specific field values. |
| "Repo setup is faster" | Direct repository data hacks create invalid state. Use real use-case paths or valid seeded fixtures. |
| "One green run is enough" | Verification requires 3 consecutive passing runs without DB reset. |
| "REVIEW: one pass is enough" | Low confidence → spawn fresh sub-agent. Never declare PASS after Round 1. |
| "Skip task creation, it's obvious" | task tracking is non-negotiable. Tracking prevents context loss. |
| "Split this TC so tests map 1:1" | One business TC → MANY tests is the expected shape. Splitting breaks spec business orientation (M1/M5). |
| "Example tests cover the rule" | A [HARD] §4 rule / §5 invariant needs a Pattern 9 property test — examples guard fixed points only. |
"Run review mode, it's the gate" | review/verify modes are inline passes; the workflow gates are the standalone $integration-test-review + $integration-test-verify skills. |
Closing reminder — Easy to Change is the success metric. Every finding, test, refactor, and abstraction must answer one question: does this make the next change cheaper or more expensive? If it doesn't reduce future change cost, reject it. Coupling, hidden state, duplicated knowledge, and unclear intent are the real enemies — call them out by name.
Source: .claude/.ck.json + .claude/skills/shared/sync-inline-versions.md (:full blocks) + .claude/scripts/lib/hookless-prompt-protocol.cjs
Generic portability boundary: Reusable skills and protocol text stay project-neutral; project-specific conventions are discovered from docs/project-config.json and docs/project-reference/. Apply shared AI-SDD from shared/sdd-artifact-contract.md. Read docs/project-config.json and docs/project-reference/docs-index-reference.md, then open the project reference docs named there. For spec, test-case, behavior-change, public-contract, or docs/specs/ work, route through the local spec docs named by the docs index: feature-spec-reference.md, spec-system-reference.md, spec-principles.md, and workflow-spec-test-code-cycle-reference.md when specs/tests/code must stay synchronized. If either file or a required reference doc is missing or stale, auto-run $project-init (or the narrow lower-level route such as $project-config, $docs-init, $scan-all, or $scan --target=<key>) before ordinary project-specific work. Any supported AI tool may execute when this shared context and local docs are available.
$start-workflow <workflowId>; for a selected skill, invoke that skill; for a custom workflow, sequence custom steps directly; for direct execution, proceed with the task.Source: .claude/skills/shared/sync-inline-versions.md
AI-SDD Artifact Contract — Shared spec-driven development rules stay portable and source-owned.
- Keep reusable AI-SDD principles in
.claude; put repository-specific paths, commands, owners, products, and formats in project config/reference docs.- Preserve cycle:
spec -> plan -> tasks -> implement -> verify -> update spec/docs.- Trace every requirement or invariant through decision, task, TC/test, source evidence, and docs/spec update.
- Treat code-to-spec extraction as reference-only until accepted by the canonical spec owner.
- Any supported AI tool may plan, implement, review, or verify with synced context; using multiple tools is optional.
- Update
.claudesource first, then sync generated mirrors; do not manually edit.agents,.codex, orAGENTS.md. — why: mirrors are generated artifacts; hand-edits are overwritten on the next sync- If
docs/project-config.json, root instruction files, or a required project-reference doc is missing or stale, auto-run$project-initor the narrow lower-level route before ordinary project-specific work.Active reference:
shared/sdd-artifact-contract.mdin the active skills root.
shared/sdd-artifact-contract.md; keep reusable AI-SDD in .claude and local rules in project docs..claude source before syncing generated mirrors; do not manually edit .agents, .codex, or AGENTS.md.$project-init or the narrow setup route automatically.
[TASK-PLANNING] [MANDATORY] BEFORE executing any workflow or skill step, create/update task tracking for all planned steps, then keep it synchronized as each step starts/completes.Break work into small tasks (task tracking) before starting. Add final task: "Analyze AI mistakes & lessons learned".
Extract lessons — ROOT CAUSE ONLY, not symptom fixes:
$learn.$code-review/$code-simplifier/$security-review/$lint catch this?" — Yes → improve review skill instead.$learn.
[CRITICAL-THINKING-MINDSET] Apply critical thinking, sequential thinking. Every claim needs traced proof, confidence >80% to act.
Anti-hallucination principle: Never present guess as fact — cite sources for every claim, admit uncertainty freely, self-check output for errors, cross-reference independently, stay skeptical of own confidence — certainty without evidence root of all hallucination.
AI Attention principle (Primacy-Recency): Put the 3 most critical rules at both top and bottom of long prompts/protocols so instruction adherence survives long context windows.
Goal-driven execution: Define success criteria first, loop until verified, and stop only when observable checks pass.
Tests verify intent: Tests must protect business rules/invariants and fail when the protected intent breaks, not only mirror current behavior.MANDATORY IMPORTANT MUST ATTENTION search 3+ existing tests in the SAME service and READ references/integration-test-patterns.md BEFORE writing — match collection, base class, helpers, unique-name generators — why: local conventions override generic templates
MANDATORY IMPORTANT MUST ATTENTION cite file:line evidence (confidence >80% to act, <60% do NOT recommend) for every claim about field changes, entities, or handler behavior — why: AI hallucinates APIs/signatures; grep to confirm before asserting
MANDATORY IMPORTANT MUST ATTENTION task tracking — break ALL work into small tasks BEFORE starting; transition one task at a time, add a final review task — why: tracking survives context loss/compaction
MANDATORY IMPORTANT MUST ATTENTION every test method carries a TC-{FEATURE}-{NNN} test-spec annotation — auto-create in Section 8 ONLY for genuinely uncovered business behavior — why: the annotation is the join key for traceability
MANDATORY IMPORTANT MUST ATTENTION one business TC maps to MANY tests (1:N, integration + unit) — NEVER split or technicalize a TC to force 1:1 — why: 1:1 splitting breaks the spec's business/user-story orientation (M1/M5)
MANDATORY IMPORTANT MUST ATTENTION for any handler enforcing a [HARD] §4 rule or §5 invariant, generate a Pattern 9 property/metamorphic test + boundary counter-case tied to a §8 Invariant/Property TC — why: example tests guard fixed points; the rule must fail across its whole input domain (mutation-kill, not line-coverage)
MANDATORY IMPORTANT MUST ATTENTION NEVER create Queries/ or Commands/ folders — instead organize by domain feature — why: CQRS-type folders fragment a domain across directories
MANDATORY IMPORTANT MUST ATTENTION NEVER mark done after one green run — verification requires 3 consecutive $integration-test-verify passes WITHOUT a DB reset — why: one run proves only the current run, not repeatability
MANDATORY IMPORTANT MUST ATTENTION review/verify are lightweight in-skill MODES — invoke the standalone $integration-test-review and $integration-test-verify skills for the heavier workflow gates — why: name-collision; modes are not the sibling skills
MANDATORY IMPORTANT MUST ATTENTION a direct user question — validate workflow/route decisions with the user. NEVER auto-decide complexity.
MANDATORY IMPORTANT MUST ATTENTION passing code/tests NEVER outrank canonical spec intent — instead reach adjudication-required with evidence before changing spec/test/code on a behavior mismatch — why: a green test can encode a regression