plugin-test

name	plugin-test
description	Run NCC plugin E2E tests. Supports quick (4 projects), full (4+monorepo+modifications), or custom test modes. Installs from current dev branch, validates spec→dev flow, skills, hooks, code quality, security, a11y, and token efficiency.
argument-hint	--quick | --full | --phase1 | --phase2 | --security | --a11y | --codequality | [project-name,...] | (no args = suggest mode)
context	fork
agent	plugin-test-orchestrator

/plugin-test — NCC Plugin E2E Test Suite

Usage

/plugin-test                    # Interactive — suggest a test mode based on recent changes
/plugin-test --quick            # Phase 1 only: 4 diverse projects × 4 features each
/plugin-test --full             # Phase 1 + Phase 2: full suite including monorepo + cross-feature mods
/plugin-test --phase1           # Phase 1 only (same as --quick)
/plugin-test --phase2           # Phase 2 only: 10-feature monorepo (solo + team)
/plugin-test --security         # Security-focused: run security-reviewer on all generated code
/plugin-test --a11y             # Accessibility-focused: run browser-tester a11y checks on UI projects
/plugin-test --codequality      # Code quality audit: deep analysis of all generated source files
/plugin-test healthcare,marketplace   # Run specific projects only

Test Modes

Phase 1: Quick Validation (--quick, --phase1)

4 diverse projects, each with 4 features + extra agent verification.

Project	Stack	Extra Agents
healthcare	Prisma + next-auth + zod + vitest	/security, /review
design-system	framer-motion + playwright + storybook	browser-tester, /qa --a11y
realtime-collab	drizzle + tanstack-query + zustand + msw	performance-optimizer, /loop
marketplace	Prisma + stripe + ai-sdk + @vercel/blob	/security --diff, /review, /status

Per-project: NCC install → /init → 4× spec→dev (3 tasks each) → extra agent runs → TEST_LOG.md

Reviewer scores 15 categories: 1-10: Installation, Hooks, Skills, Spec, Design, PLAN, TDD, Token, Code, Flow 11: Rules size (<200 lines each) 12: Skill selection accuracy (manifest vs package.json) 13: Extra agent execution results 14: Document sync (CONTEXT.md/design.md consistency) 15: Code quality detail (error handling, Zod, composition, Server/Client)

Phase 2: Large-scale Monorepo (--phase2)

2 identical CRM projects (solo vs team mode), each with:

• 10 features in dependency chain
• 5 cross-feature modifications (api-layer error format, RBAC expansion, tagging, cursor pagination, custom stages)
• Document Sync verification (CONTEXT.md, design.md, history entries)
• Solo vs Team comparison

Features: api-layer → auth-system → contact-management → deal-pipeline → email-integration → activity-feed → reporting → team-workspace → notification-center → admin-settings

Full Suite (--full)

Runs Phase 1, analyzes issues, then runs Phase 2. Generates consolidated REPORT with cross-phase comparison.

Security Audit (--security)

For each generated project:

• Read installed security-reviewer agent
• Scan all API routes for OWASP Top 10: injection, auth bypass, sensitive data exposure, CSRF
• Check MSW handlers for auth mock bypass patterns
• Check Zod validation coverage
• Output: SECURITY_REVIEW.md per project

Accessibility Audit (--a11y)

For UI-heavy projects (design-system or any with UI components):

• Read installed browser-tester agent
• WCAG 2.1 AA checklist per component
• Check: ARIA attributes, keyboard nav, focus management, color contrast
• Check: prefers-reduced-motion respect, semantic HTML, role attributes
• Output: ACCESSIBILITY_REVIEW.md per project

Code Quality Audit (--codequality)

Deep source code analysis across all projects:

• Error handling grade (try/catch, error classification, no silent swallowing)
• Zod validation grade (boundary validation, schema completeness)
• TypeScript strictness (no any, no as unknown, proper inference)
• Composition patterns (Context vs prop drilling, compound components)
• Server/Client discipline ('use client' minimization)
• DRY compliance (no duplicate logic across routes)
• Named constants (no magic numbers/strings)
• Output: code quality table in REPORT

Review Checklist (15 categories, /15 scoring)

#	Category	What to check
1	Installation	agents 25+, scripts 6+, skills 5+, rules 3, spec/rules 8+, CLAUDE.md
2	Settings & Hooks	env keys, SessionStart(2), PreToolUse(2), PostToolUse(3), Stop(1)
3	Skill Selection	core skills vs package.json library matching
4	Spec Quality	frontmatter (mock, testing, deps), REQ-NNN:, all required sections
5	Design Quality	Components, State, Data Flow, Technical Decisions
6	PLAN.md Quality	domain tags, model, wave, MSW tasks, Approved-at, Budget, Team Composition (team mode)
7	TDD/Mock	MSW handlers for all endpoints, mock:true enforcement, test files
8	Token Efficiency	file sizes <200 lines, artifact limits, skill budget rules
9	Code Quality	try/catch, Zod, strict TS, no stubs, Server/Client
10	Flow Completeness	STATE.md, CONTEXT.md, [x] tasks, TEST_LOG.md
11	Rules Size	all spec/rules/ <200 lines, no redundancy
12	Skill Accuracy	manifest vs detected libs, on-demand coverage
13	Extra Agents	security/a11y/performance/review/loop results
14	Document Sync	CONTEXT.md consistent after modifications, no stale decisions
15	Code Quality Detail	error handling grade, composition, naming, DRY

Report Output

Test artifacts are written to __plugin-tests__/ during execution:

• Per-project: TEST_LOG.md, REVIEW.md
• Extra agents: SECURITY_REVIEW.md, ACCESSIBILITY_REVIEW.md, PERFORMANCE_REVIEW.md, REVIEW_RESULT.md

After each test run, generate a key-summary English report and save it to reports/REPORT_YYYYMMDD_HHMM.md (inside this skill directory). The report should contain:

• Date, branch, version, scope
• Score summary table
• Key findings (bullet points, not full prose)
• Critical issues with severity
• Recommendations

Keep each report under 80 lines. This is the archival summary — the raw artifacts in __plugin-tests__/ have full details.

Past Reports

Reports are stored in reports/ directory. By default, read only the latest report (highest datetime in filename) to understand current plugin quality baseline. Read older reports only when the user explicitly asks for trend analysis or historical comparison.

Report	Scope	Score
REPORT_20260321_1900.md	Main branch validation (2 projects)	9.5/10 avg
REPORT_20260321_1700.md	R5: Incremental fix-and-retest (3 projects)	8.7/10 avg
REPORT_20260321_1500.md	R4: Full suite Phase 1+2 (4+2 projects, 15 categories)	12.0/15 avg
REPORT_20260321_1300.md	R3: Monorepo solo vs team (10 features × 2 modes)	Solo 6/10, Team 5/10
REPORT_20260321_1100.md	R2: 4 projects × 4 features (post-fix)	9.0/10 avg
REPORT_20260321_0900.md	R1: 4 projects × 1 feature (baseline)	7.5/10 avg

NCC Source Path

The installer is invoked from the dev build: node {NCC_SOURCE}/dist/index.js This tests the current branch, not the published npm version.