| name | mind-sets-and-structured-techniques |
| description | Invoke to audit whether a judgment rests on an untested mind-set, filters out discrepant evidence, or skips a structured technique like Alternative Futures before the estimate is finalized. |
| kind | skill |
| status | ready |
| provenance | {"principles":["P009","P010","P100","P111","P112","P139","P142","P163","P165","P171","P184","P185"],"claims":["C00098","C00099","C00100","C00101","C00102","C00103","C00104","C00105","C00117","C00118","C00121","C00124"],"evidence":[],"source_anchors":[],"authored_from_digest":"0d5dc762429e77c2aa25a2b8e0bbe83ab2135173cd5165e3a68cfeb96d06d67c"} |
Mind Sets And Structured Techniques
Purpose
Review whether an analytic judgment rests on a mind-set or mental model that was named and tested against a stated alternative, rather than one left unexamined and simply confirmed. Reliance on such models to simplify reality is unavoidable and often useful, but at times hazardous, so this skill checks whether the frame was actually challenged: with a structured technique, against evidence that did not fit it, and against a model, axiom, or category built for one environment but carried unchanged into a changed one. This skill audits the frame and the technique used to test it — not the substance of the estimate itself.
When to use
- A judgment or estimate rests on a single interpretive frame or mind-set that has not been named, or tested against a stated alternative.
- A plausible-but-unlikely, surprising, or emotionally charged possibility is being dismissed rather than explored with a perspective-shifting technique.
- Evidence that does not fit the prevailing frame appears to have gone unnoticed, been explained away as compatible, or been flatly refused — or the write-up assumes the right conclusion will simply surface because the evidence for it exists.
- A long-held model, axiom, or precedent is being applied to a changed environment or context without re-checking that its enabling conditions still hold.
- A hard or unfamiliar problem is being worked with the same method that solved the last one, with no visible check for whether a different approach is needed.
- A belief appears to be surviving contrary evidence through a carve-out — separating an actor's stated policy from disposition, or an exception from a general rule — rather than genuine revision.
- The categories used to file the evidence look too rigid or too coarse, or new substantive material needs checking for whether it was actually retained rather than noted once.
- A judgment reads as unusually resistant to a single fact that contradicts the analyst's prior view.
Procedure
- Identify the mind-set or mental model doing the filtering behind the judgment, name it explicitly, and treat it as a challengeable simplification of reality rather than settled fact (P100).
- For a high-uncertainty, high-consequence question, check whether the analysis tested the frame with Alternative Futures rather than trusting a single-outcome call — two critical, uncertain drivers crossed into four future worlds with plausible stories and signposts, with policymakers exposed to the result (P009).
- For a plausible-but-unlikely, surprising, or emotionally charged possibility, check whether a perspective-shifting technique was used — such as assuming the event occurred and reasoning backward to explain it — rather than the possibility simply being dismissed (P010).
- Test how evidence that did not fit the frame was treated: not noticed, reinterpreted as compatible, or refused outright are the three classic filtering failures, and each should be named where present rather than left unexamined (P163).
- Check whether the write-up is banking on the correct conclusion surfacing simply because the evidence for it exists: a signal against an improbable target is heard only if someone is listening for it, so confirm that watch was actually being kept (P165).
- Where the judgment rests on a long-held model, axiom, or precedent, check it against the current environment: schemata expire as the world that validated them changes (P142), and a pattern or axiom valid under old conditions can fail silently once those conditions are gone (P171).
- Check the grain of the categories used to file the evidence: an inappropriate or hardened category can make a signal impossible to perceive, store, or retrieve, so look for fine distinctions and tolerance for ambiguity in its place (P184).
- Where the problem is hard or unfamiliar, check whether the method that solved the last one was reused by default, or whether the analysis paused to ask whether a different approach — often easier to see from outside the established framework — was needed (P111).
- Where a belief survived a piece of contrary evidence, check how: a genuine revision, or a differentiation move that splits off the conflicting part — for example separating an actor's stated policy from disposition, or carving out an exception — to keep the broader belief intact (P112).
- Confirm any new substantive material behind the judgment was retained through association with an existing schema and deep processing, not rote exposure, which does not transfer into long-term use (P139).
- Check the analyst's reaction to a single disconfirming fact: flagged and highlighted as useful signal, or denied, downplayed, or ignored because the conservative mind resists changing an established view (P185).
- Emit findings highest-impact first, each naming the mind-set failure or filtering mechanism, the principle(s) it rests on, the corrective technique, and the residual uncertainty.
Inputs
- The judgment or estimate under review, and the frame, model, or assumption it appears to rest on, stated or inferred from the write-up.
- Any evidence reported as surprising, anomalous, or discrepant, and how the write-up characterized or handled it.
- Whether the question was uncertain and consequential enough to warrant a structured technique, and whether one — Alternative Futures, a perspective-shift — was actually used.
- The environment or context in which the underlying model, axiom, or precedent was originally validated, versus the context it is now being applied to.
- The categories or classification scheme used to file the evidence, where visible in the write-up.
- Any record of how the analyst or team has reacted to a disconfirming fact in the past.
Output
Per finding: name the mind-set failure or filtering mechanism (an untested single frame, a discrepant signal not noticed, reinterpreted, or refused, a model or axiom carried past its enabling conditions, a hardened or ill-fitting category, unexamined method-reuse, a belief preserved by a carve-out, rote-only retention, or a denied disconfirming fact) and the error it produces, apply the principle(s) by ID, give the corrective technique (name and test an explicit alternative, run the matching structured technique, re-check the model's enabling conditions against the current context, re-draw the category, question the default method, or foreground the anomaly), state the residual uncertainty the correction leaves, and end with a concrete next step. Order findings highest-impact first. This skill critiques how the frame was formed, tested, and defended — it never substitutes the substantive judgment or certifies the analysis correct.
Anti-patterns to flag
- Confirming a single frame instead of naming and testing an explicit alternative when the stakes and uncertainty warrant one (P100, P009).
- Dismissing a low-probability, high-consequence, or emotionally charged possibility without applying a perspective-shifting technique such as thinking backward (P010).
- Discrepant evidence going unnoticed, quietly reinterpreted as compatible, or flatly refused, with none of the three failure modes named (P163).
- Assuming the correct conclusion will emerge from the evidence on its own, with no one credited with watching for the disconfirming signal (P165).
- A long-held model, axiom, or precedent carried into a changed environment or context without re-checking that its enabling conditions still hold (P142, P171).
- A hardened or ill-fitting category left unexamined as the reason a signal was missed or misfiled (P184).
- A familiar method reused on a hard or novel problem with no consideration that it may need breaking (P111).
- A belief preserved by carving off the conflicting part — splitting policy from disposition, or the actor from the general rule — instead of being revised (P112).
- New substantive material asserted as retained after only rote or one-time exposure, with no schema-linked, deep-processed learning (P139).
- A single disconfirming fact denied, downplayed, or ignored instead of flagged as useful signal (P185).
References
See ../../references/bias-perception-principles-index.md for the full principle catalogue. For adjacent concerns, see the sibling skills: motivated-reasoning-and-belief-perseverance covers identity-linked, ego-protective resistance to discrepant evidence, as distinct from this skill's frame- and schema-driven filtering; historical-analogy-learning-and-hindsight covers a vivid historical analogy or an over-applied successful policy, and the hindsight bias that makes an old framework's replacement look obvious only in retrospect; perception-attribution-of-intent-and-signaling covers reading another actor's intentions and signals, including the slow-to-update first-hand image.
Provenance
Derived solely from P009, P010, P100, P111, P112, P139, P142, P163, P165, P171, P184, and P185 (A Tradecraft Primer: Structured Analytic Techniques for Improving Intelligence Analysis; Psychology of Intelligence Analysis; Perception and Misperception in International Politics — all distillation-only; see the frontmatter above for the full claim, evidence, and source-anchor list).