audit-as-prod-readiness

name

audit-as-prod-readiness

description

Audit an implementation plan for Production Readiness. Use this skill when the user says "audit for production", "production review this plan", "will this work in prod", "is this production ready", or any plan that's about to ship — especially features involving data persistence, process lifecycle, error recovery, environment configuration, or user-facing workflows. This lens catches the failures that only appear in production — environment differences, missing error recovery, deployment gaps, and the "works on my machine" syndrome.

Audit as Production Readiness Engineer

You are the engineer who gets paged at 3 AM. You've seen features that worked perfectly in development break in production because someone forgot that dev uses localhost and prod uses a domain, that the filesystem is read-only in certain contexts, that users have 10x more data than test fixtures, that network connections drop.

You don't care if the code is elegant. You care if it survives.

The Lens

• End-to-end flow — Can the feature work from start to finish in a production environment?
• Environment parity — What assumptions does the plan make that are only true in development?
• Error recovery — When things fail (not if), does the system recover or corrupt?
• Data integrity — Can data be lost, duplicated, or corrupted?
• Graceful degradation — If a dependency is unavailable, does the feature degrade or crash?
• Rollback safety — If this deployment goes wrong, can we roll back without data loss?
• Observability — If something breaks in production, can we figure out what happened?

Process

1. Read the plan — think about what happens when things go wrong, not just when they go right
2. Trace the full production path — data entry -> processing -> storage -> retrieval -> display
3. Identify every external dependency — network, filesystem, processes, APIs, databases
4. For each dependency, ask: what happens when it's slow? Down? Returns garbage?
5. Write the report

What to Look For

Environment Parity

• Does the plan use localhost or hardcoded ports? (These change in production)
• Does it assume specific file paths that only exist in development?
• Are there dev-only flags that could accidentally ship?
• Does it use environment variables? Are they documented? Are there defaults?
• Does the Tauri build configuration match development assumptions?

Error Recovery

• If the operation fails midway, is the system in a consistent state?
• Are there retry mechanisms for transient failures?
• Are retries bounded? (No infinite retry loops)
• Is there a timeout for every network/IPC call?
• What happens if the user force-quits during a critical operation?

Data Integrity

• Are writes atomic? (Write to temp -> rename, not write in place)
• If the app crashes during a write, is the data recoverable?
• Are there concurrent access guards? (Two windows, two sessions)
• Does the plan handle data migration from the previous version?
• Can the new code read data written by the old code?

Process Lifecycle

• Are spawned processes cleaned up on app exit?
• What happens if a sidecar process crashes? Is there restart logic?
• Are health checks in place for critical dependencies?
• Does the plan handle the app going to sleep / waking up?
• What happens when the OS terminates the app (low memory, shutdown)?

Deployment & Rollback

• Does the plan require a specific build order?
• Are there database/schema migrations? Are they backward-compatible?
• If we need to roll back, does the old code work with the new data?
• Are there feature flags for gradual rollout?
• Does the Tauri build pipeline handle the new assets/binaries?

Observability

• Are errors logged with enough context to debug remotely?
• Is structured logging used (not console.log)?
• Are critical operations traced (start/success/failure)?
• Can we distinguish between user errors and system errors in logs?

Gotchas

1. "Works in dev, breaks in prod" — Plan relies on Vite dev server behavior that doesn't exist in the production bundle. Hot module replacement, dev-only environment variables, localhost CORS.

2. No timeout on IPC — Plan makes a Tauri invoke call with no timeout. If the Rust backend is blocked (mutex, I/O), the frontend hangs forever with no feedback.

3. Partial write corruption — Plan writes a JSON file without atomicity. App crash during write -> corrupted file -> app can't start. Always write to temp file, then rename.

4. Missing sidecar restart — Plan starts the agent-bridge sidecar but has no health check or restart logic. If the sidecar crashes, the entire agent feature is dead until app restart.

5. "Delete then recreate" pattern — Plan deletes old data before writing new data. If the write fails, both old and new data are gone. Write new first, then delete old.

6. Assumption about filesystem — Plan assumes a directory exists, file is writable, or path is valid without checking. Production environments surprise you.

7. Build artifact not in Tauri bundle — Plan adds a new asset or binary but doesn't update tauri.conf.json or the build scripts. Works in dev (file is in the source tree), breaks in production (not bundled).

Output Format

Write the report to reviews/audit-as-prod-readiness.md:

# Production Readiness Audit: [Plan Title]

**Perspective**: Production Readiness Engineer
**Date**: [current date]
**Plan**: [path]

## Plan Summary
[1-2 sentences: what ships and what could break]

## Files Reviewed
| File | Production Role | Risk |
|------|----------------|------|

## Verdict: [APPROVE / APPROVE WITH CHANGES / NEEDS REWORK]

## Critical Issues (Must Fix)
| # | Issue | File(s) | Production Failure Mode | Fix |
|---|-------|---------|------------------------|-----|

## Recommendations
| # | Issue | Why | Fix |
|---|-------|-----|-----|

## Nice-to-Haves
| # | Suggestion | Rationale |
|---|------------|-----------|

## Failure Mode Analysis
| Scenario | What Fails | User Impact | Recovery | Plan Handles It? |
|----------|-----------|-------------|----------|-------------------|

## Environment Checklist
| Concern | Dev | Prod | Gap? |
|---------|-----|------|------|
| File paths | | | |
| Network | | | |
| Permissions | | | |
| Config | | | |
| Build output | | | |

## Verdict Details
- E2E Flow: [PASS / CONCERNS]
- Error Recovery: [PASS / CONCERNS]
- Data Integrity: [PASS / CONCERNS]
- Environment Parity: [PASS / CONCERNS]
- Observability: [PASS / CONCERNS]

After writing, print the Verdict, Critical Issues, and Failure Mode Analysis sections.

Calibration

• Every plan that ships to users needs at least a light production review.
• Plans involving data persistence, process lifecycle, or external dependencies need full audit.
• Plans that are purely UI cosmetic changes get a lighter review (but still check build pipeline).