| name | grillmester-diagnosing-bugs |
| description | Builds a tight reproduction loop, minimizes the symptom, tests ranked hypotheses, and locks the fix down with regression evidence. Use when something throws, fails, hangs, flakes, regresses in performance, or only fails at runtime. |
Diagnosing Bugs
A discipline for hard bugs. Skip phases only when you can explicitly justify it.
Use the active task or calling brief as scope. If the repository advertises
domain documentation or binding decisions, read only what touches the symptom;
the workflow does not depend on any particular documentation path.
Before choosing a command or test shape, discover the repository's runtime and
test contract from manifests, scripts, neighboring tests, CI configuration and
local run documentation. Record the detected language, framework, test runner,
focused command, application boot command and available fixtures. Do not assume
Gradle, Kotest, Ktor, Node, pytest, containers, Kafka or a database until
repository evidence establishes them.
Before showing or saving command output, a HAR, log, trace or event, replace
secrets, auth headers, cookies, tokens and personal or sensitive data with
<REDACTED>; retain only signal lines. Keep required credentials in approved
environment variables, never in commands, scripts or fixtures. If redacted
evidence cannot establish the boundary, return Status: NEEDS_CONTEXT and name
the approved evidence or access needed instead of asking for raw data.
If the symptom is a runtime/platform problem in production, use the platform's
approved diagnostic tooling to establish the failing boundary, then return here
for the reproduction and fix discipline. When the app runs on NAIS,
grillmester-nav-troubleshoot can supply Nav-specific diagnostic trees.
Phase 1 — Build a feedback loop
This is the skill itself. Everything else is mechanics. If you have a tight pass/fail signal for the bug — one that goes red on this bug — you will find the cause; bisection, hypothesis testing and instrumentation merely consume the loop. Without it, no amount of code reading will save you.
Spend disproportionate effort here. Be aggressive. Be creative. Do not give up.
Ways to construct one — try them roughly in this order
- Failing test at the seam that reaches the bug — unit, integration, or
application test in the framework already used by the repository. Run the
discovered focused command and assert the exact symptom.
- HTTP, CLI, or protocol script against the repository's discovered local
boot path, diffing status, output, or response against known-good behavior.
- Replay of a captured event. Save a sanitized representative message,
HTTP payload or event artifact and play it through the code path in isolation.
- Throwaway harness. Spin up the smallest subset that reaches the failing
path, reusing the repository's existing fakes, fixtures, embedded services,
or container strategy where evidence supports them.
- Property / fuzz loop. If the bug is "sometimes wrong output", run 1000 random inputs and look for the failure mode.
- Bisection harness. If the bug appeared between two known states (commit, dataset, version), automate "boot at X, check, repeat" so you can
git bisect run it.
- Differential loop. Run the same input through the old vs. the new version (or two configurations) and diff the output.
- HITL bash script. Last resort. If a human has to click/act, drive them with
scripts/hitl-loop.template.sh so the loop stays structured. Only sanitized signal output is fed back to you.
Build the right feedback loop and the bug is 90% fixed.
Tighten the loop
Treat the loop as a product. Once you have a loop, tighten it:
- Can I make it faster? (Cache setup, skip unrelated initialization, use the
test runner's focused selector, reuse an existing fixture.)
- Can I make the signal sharper? (Assert on the specific symptom, not "did not crash".)
- Can I make it more deterministic? (Pin time, seed randomness, isolate mutable
state, and replace uncontrolled network access at an established seam.)
A 30-second flaky loop is barely better than no loop; a 2-second deterministic one is tight — a debugging superpower.
Non-deterministic bugs
The goal is not a clean repro, but a higher reproduction rate. Loop the trigger 100×, parallelize, add stress, narrow timing windows, inject sleeps. A 50% flaky bug is debuggable; 1% is not — raise the rate until it is.
When you genuinely cannot build a loop
Stop and say so explicitly. List what you tried. Ask the user for: (a) approved
access to the environment that reproduces it, (b) a captured artifact such as a
HAR file, previous-process logs, event payload or trace, or (c) permission for
temporary instrumentation. Do not move on to hypotheses without a loop.
Completion criterion — a tight loop that can go red
Phase 1 is done when the loop is tight and red-capable: you can name one command — a script path, a test invocation, a curl — that you have already run at least once (paste the sanitized invocation and signal-only output), and that is:
If you catch yourself reading code to build a theory before this command exists, stop — jumping straight to a hypothesis is exactly the mistake this skill prevents. No red-capable command, no phase 2.
Phase 2 — Reproduce + minimize
Run the loop. Watch it go red — the bug shows up.
Confirm:
Minimize
Once it is red, shrink the repro to the smallest scenario that still goes red. Cut inputs, callers, config, data and steps one at a time, rerunning the loop after each cut — keep only what is load-bearing for the bug.
Why bother: a minimal repro shrinks the hypothesis space in phase 3 (fewer moving parts left to suspect) and becomes the clean regression test in phase 5.
Done when every remaining element is load-bearing — remove any one of them and the loop goes green.
Do not move on before you have reproduced and minimized.
Phase 3 — Hypothesize
Generate 3–5 ranked hypotheses before testing any of them. Single-hypothesis generation anchors on the first plausible idea.
Each hypothesis must be falsifiable: state the prediction it makes.
Format: "If is the cause, then will make the bug disappear / will make it worse."
If you cannot state the prediction, the hypothesis is a gut feeling — discard it or sharpen it.
Show the ranked list to the user before testing. They often have domain knowledge that re-ranks it instantly ("we just deployed a change to #3"), or know hypotheses they have already ruled out. Cheap checkpoint, big time saver. Do not block on it — proceed with your own ranking if the user is away.
Phase 4 — Instrument
Each probe must map to a specific prediction from phase 3. Change one variable at a time.
Tool preference:
- Debugger / REPL inspection if the environment supports it. One breakpoint beats ten log lines.
- Targeted logging at the boundaries that separate the hypotheses, using
the repository's established logging framework.
- Never "log everything and grep".
Tag every debug log with a unique prefix, e.g. log.info("[DEBUG-a4f2] ..."). Cleanup at the end becomes a single grep. Untagged logs survive; tagged logs die.
PII boundary (Nav): never log national identity numbers, tokens, names or special categories of personal data — not even in temporary debug logs. Log IDs/correlation (Nav-Call-Id, callId), not personal data.
Perf branch. For performance regressions, logs are usually the wrong tool.
Establish a baseline with the profiler, metrics, benchmark or query-plan tooling
already supported by the stack, then bisect. Measure first, fix afterwards. On
a managed platform, use its approved observability tooling to establish the
boundary before changing application code.
Phase 5 — Fix + regression test
Write the regression test before the fix — but only if a correct seam exists for it.
A correct seam is one where the test hits the real failure pattern as it occurs at the call site. If the only available seam is too shallow (a single-caller test when the bug requires several callers, a unit test that cannot replicate the chain that triggered the bug), a regression test there gives false confidence.
If no correct seam exists, that is itself the finding. Note it. The architecture prevents the bug from being locked down. Flag it for the next phase.
If a correct seam exists:
- Turn the minimized repro into a failing test at that seam.
- Watch it fail.
- Apply the fix.
- Watch it pass.
- Run the phase 1 loop against the original (un-minimized) scenario.
Pass/fail is decided with the repository's discovered focused test command and
proportionate broader gates. No "looks right" claim without fresh evidence —
command, relevant output and exit code in the same message.
Phase 6 — Cleanup + post-mortem
Required before you declare done:
Then ask: what would have prevented this bug? If the answer involves an
architectural change (no good test seam, entangled callers, hidden coupling),
carry the finding forward via /grillmester-grilling. Use
/grillmester-architecture-review for consequential architecture questions.
When lasting concepts or decisions ought to be
documented, recommend the repository's documented route when one exists and
wait for the user's choice before /grillmester-domain-modeling writes. Give the
recommendation after the fix is in, not before — you know more now than when
you started.
Runtime/platform symptoms
For a production-only failure, identify the layer before changing code:
deployment/startup, identity or authorization, messaging, database, or
observability. Use only repository-approved platform tools, keep the pass
read-only until the boundary is known, and then return to phases 5–6 here.
Always propose the least invasive fix first. Production configuration changes,
workload restarts and managed-resource changes require explicit approval.
grillmester-nav-troubleshoot gives deeper NAIS trees for pod startup, Nav
identity, Kafka, Cloud SQL and observability. If required live platform evidence
is unavailable, name the missing capability or owner documentation instead of
inventing Nav behavior.
Related skills
/grillmester-grilling — stress-test the design when the bug exposes a design gap;
recommend the documented route when neededgrillmester-auth-overview — Azure AD / TokenX /
ID-porten / Maskinporten / Texas when those mechanisms are involved/grillmester-architecture-review — review architectural changes that would
have prevented the bug
