critical-thinking

name

critical-thinking

description

Think clearly and decide well under uncertainty. Use this skill whenever you reason through a hard problem, analyze or critique an argument, evaluate a claim or a statistic, weigh evidence, forecast or estimate odds, make or pressure-test a decision, diagnose a recurring failure, red-team an idea, brainstorm or generate ideas and options, redesign something, model a situation, or check your own reasoning for bias. Grounded in 51 books on judgment, reasoning, creativity, systems, uncertainty, models, and the philosophy of science (Kahneman's "Thinking, Fast and Slow", Galef's "Scout Mindset", Tetlock's "Superforecasting", Silver, Duke, Meadows, Dennett, de Bono, Deutsch, Sagan, Pigliucci, Bergstrom and West's "Calling Bullshit", Rosling's "Factfulness", Bazerman, Hastie, plus Koestler's "Act of Creation", von Oech, de Bono's "Six Thinking Hats", Johnson's "Where Good Ideas Come From", Brown's "Change by Design", Norman's "Design of Everyday Things", Hofstadter's "Surfaces and Essences" and "Godel, Escher, Bach", Minsky, Scott's "Seeing Like a State", Gall's "Systemantics", Senge's "Fifth Discipline", Jacobs, Taleb's "Antifragile" and "The Black Swan", Page's "Model Thinker", James/Witten/Hastie/Tibshirani's "Introduction to Statistical Learning", Simon, Dixit and Nalebuff's "Art of Strategy", Kuhn's "Structure of Scientific Revolutions", Popper, Feyerabend, and Pritchard). Reach for this for "think through", "is this true", "is this argument sound", "evaluate this claim", "what could go wrong", "should I", "what are the odds", "red-team this", "find the flaw", "brainstorm", "generate ideas", "generate options", "redesign this", "what's the model", "is this fragile or robust", "what could blindside us", "what's the paradigm", and any judgment, analysis, forecasting, decision, design, or ideation task, even when no book is named. The deep tool libraries in references/ load on demand, by task.

Think clearly and decide well. The first answer your mind offers is a hypothesis, not a verdict. This skill is a toolkit for catching your own errors, reasoning cleanly, quantifying uncertainty, stress-testing claims, thinking in systems, generating real alternatives, and deciding under uncertainty. It carries the working tools of 51 books on judgment, creativity, systems, uncertainty, models, and the philosophy of science. The directives below are the operating manual; references/ holds the deep tool libraries and a per-book teaching library.

How to use this

Apply the phases that fit the task. Phase 1 (frame) and Phase 2 (check yourself) run on almost every hard question; the rest engage as the problem demands. Load a reference file only when the task needs that depth, and load a per-book file only when a task calls for that book. Read only what the task needs. When two directives seem to conflict, scope to purpose (see "When the directives collide").

Phase 1. Frame the question

• State the exact question. Pin the issue and the conclusion in plain words before reacting. Sort the issue: is it descriptive (what is) or prescriptive (what ought)? The two need different evidence.
• Catch the swap. Ask what you were actually asked and what easier question your mind answered instead. A hard call that suddenly feels easy and emotionally clear is a substitution (attribute substitution).
• Set the boundary on purpose. Decide what is inside the frame and what is out, then deliberately pull back in the delayed effects, distant people, and long-term consequences you first excluded.

Phase 2. Check yourself (bias and the scout stance)

• Ask "Is it true?" rather than "Can I believe it?" or "Must I believe it?" Notice which question you were running. You bend evidence toward what you want and away from what you resist, so flip the standard and re-check.
• Hold beliefs as probabilities and your identity lightly. State a number rather than a certainty, and arrange things so being wrong costs you nothing. A belief welded to your identity gets defended instead of tested, so hold it lightly.
• Run the selective-skeptic test. If this same evidence pointed the other way, would you still find it credible? A different standard for friendly and unfriendly evidence is a double standard.
• Hunt disconfirming evidence first. Record every fact that cuts against you the instant you meet it, because the mind drops inconvenient facts faster than convenient ones. Lean into confusion rather than explaining it away.

Phase 3. Reason and argue cleanly

• Separate the conclusion from the reasons, and let reasons come first. A conclusion with no reasons is a bare assertion. A conclusion chosen first with reasons scrambled in afterward is the tell of motivated reasoning.
• Surface the hidden premise and the value judgment. Most arguments leave a premise unstated, and the weakness usually hides there. Name the value the arguer had to rank first to reach the conclusion.
• Steelman before you strike. Re-express the opposing view so well its holder would endorse your version, then engage the strongest form (Rapoport's rule, the principle of charity).
• Name the fallacy. Keep the high-frequency roster loaded: ad hominem, straw man, false dilemma, slippery slope, begging the question, post hoc, equivocation, red herring, and appeal to questionable authority. (references/argument-and-evidence.md)

Phase 4. Quantify and forecast

• Base rate first, then adjust. Find the reference class and anchor on how often things like this happen in general (the outside view) before you touch the vivid specifics of this case (the inside view).
• Put a number on it and decompose the impossible. Translate "likely" into a probability. Fermi-ize a hard estimate into parts you can each guess, then recombine.
• Update in small steps and keep score. Nudge on genuinely diagnostic evidence; avoid both freezing on a prior and lurching on a flashy detail. Log forecasts and grade them, because a forecast you never score teaches nothing.
• Know which world the variable lives in. In a mild domain no single case dominates the total, so averages hold. In a wild domain one case can swamp everything, so the average misleads and the tail rules. Check the domain before you trust a mean, a standard deviation, or a typical case (the ludic fallacy treats a wild, open system as a casino with known odds).
• Distrust the model that best fits the past. The most flexible model can memorize noise and forecast worse out of sample (overfitting). Judge a model on data it never saw, and prefer the simpler fit when predictors outnumber clean signal. (references/forecasting-and-decisions.md, models-and-formal-thinking.md, uncertainty-and-risk.md)

Phase 5. Stress-test (red-team and call bullshit)

• Interrogate the black box. Audit the data going in and the result coming out without needing the math. Ask "compared to what?", "out of what?" (the denominator), and "which average?" before trusting any statistic.
• Read the axes before the shape, and demand effect size with every p-value. A tiny real bias across a huge sample manufactures statistical significance.
• Default to the prosaic and demand evidence proportional to the claim. Rule out misperception, error, coincidence, and selection before reaching for the extraordinary. Ask what observation would prove the claim false.
• Prefer explanations that are hard to vary. An account you could reshape to fit the opposite outcome just as comfortably is weak, however confident it sounds. (references/argument-and-evidence.md, systems-science-and-creativity.md)

Phase 6. Think in systems

• Look for the structure behind it. When a problem keeps recurring, stop hunting the person who caused this instance and map the stocks, flows, feedback loops, and delays that make the behavior the system's default.
• Aim high on the leverage hierarchy and audit your metrics. Push on goals, rules, and information flows over tweaking mere numbers. The system delivers exactly the indicator you specify, so you get what you measure.
• Respect local knowledge over the legible abstraction. A central plan reshapes the world into what it can measure and erases the situated know-how that actually makes the work function (the high-modernism trap). Keep the practitioner who holds the unwritten skill inside the decision loop, and date a young success before you praise it, since it may be feeding on reserves it did not build.
• Grow systems from working seeds (Gall). A complex system that works evolved from a simple one that worked; a complex system designed whole rarely works and resists patching. Expect every system to pursue its own survival regardless of the mission on the door, and read a person inside it from incentives rather than words.
• Match the pattern to a system archetype. When a problem recurs, check it against limits to growth, shifting the burden, eroding goals, escalation, and tragedy of the commons. The archetype points you to the leverage and the trap. (references/systems-science-and-creativity.md, systems-and-complexity.md)

Phase 7. Generate alternatives

• Set a quota and suspend judgment. Produce several readings even after a good one arrives, because the first acceptable answer suppresses the rest. Let a wrong-looking idea be a stepping stone. Use reversal, analogy, and a random input to break the pattern, then find the hidden option C. Generate first, then switch to analysis to test what you produced.
• Bisociate: force two unrelated frames together. Name the matrix you are stuck inside, then describe the problem inside two or three foreign frames until two rule-sets both apply at once. The new option lives where the frames overlap.
• Run the Six Hats as separate passes. Generate (green), judge for risk (black), and search for value (yellow) in scheduled turns rather than all at once, so judgment does not strangle generation. Quarantine criticism inside its own pass.
• Name the mental lock you are obeying, then break it. List the constraints you are treating as fixed (the one right answer, be practical, follow the rules, avoid ambiguity) and ask which are real and which are inherited habit.
• Reach into the adjacent possible. Build the next option from parts available now, and prefer the recombination that opens the most further doors over a leap to a destination whose pieces do not exist yet.
• Use analogy as the generative engine. Strip the problem to its relational skeleton, find another domain with the same skeleton, borrow its solution, then mark every point where the analogy breaks.
• Run the design loop: diverge then converge, and prototype to think. Widen options with judgment suspended, then switch modes and narrow. Build a rough, cheap artifact to externalize a vague idea, because a prototype surfaces problems no discussion will. (references/creativity-and-ideation.md, systems-science-and-creativity.md)

Phase 8. Decide under uncertainty

• Judge the decision on what was knowable. Grade a choice by the information and reasoning available at the time, never by how it happened to land (resulting). Frame the choice as a bet that names the alternative futures and the opportunity cost. Ignore sunk costs and decide on future consequences alone. Run a premortem, aggregate small positive-expected-value bets, and hold extra caution for the unquantifiable tail. (references/forecasting-and-decisions.md)

When the directives collide

When two moves seem to conflict, scope the choice to the purpose and the conditions in front of you.

• Trust or distrust intuition: diagnose the domain. Let intuition lead only when the environment is regular enough to hold learnable patterns and you got rapid, clear feedback while learning it (a surgeon's hands, a firefighter's read of a room). In noisy, low-feedback domains (markets, geopolitics, one-off strategy), distrust the gut and substitute base rates, checklists, or a simple model.
• Use falsifiability as a flashlight. Ask "what would change your mind?" and treat a confident "nothing could" as a strong tell. Score a claim across several marks (testable predictions, response to disconfirmation, progress, details pinned by reality) rather than passing or failing it on one rule. Demarcation is a gradient.
• Quantify the tractable middle, stay humble at the tail. Forecast where the domain has feedback and refuse to extrapolate past the horizon where skill decays. Separate epistemic uncertainty (knowable, push on it) from aleatory uncertainty (irreducibly random, stay cautious).
• Separate generation from analysis by phase. Generate with judgment suspended, then switch to rigor to test. The two sabotage each other only when run at once.
• Spend rigor where it pays (stakes-triage). Reserve full deliberation for choices that are important, hard to reverse, unfamiliar, or numeric. Let fast judgment handle low-stakes, reversible, high-frequency calls. Refuting a bad claim costs far more than making one, so aim your scrutiny at the load-bearing claim.
• Model versus reality: many models in the middle, distrust any model in the tail. Run several models where the domain has feedback and the regular middle holds, and let their errors cancel. In the fat tail, where one event can dominate, trust no single model and manage exposure instead, because the clean odds were never real there.
• Restraint versus completeness: cut hard, then check the cut. Prune what does not earn its place, then reverse the test and confirm that nothing supported and decision-relevant was dropped. The first pass fights bloat; the second pass fights the omission that bloat-fighting causes.
• Paradigm versus anomaly: park the small misfit, let the persistent one bite. A single anomaly inside a working framework is usually the worker's puzzle to solve, so park it. When anomalies accumulate, resist repair, and force the field to reopen fundamentals, treat the misfit as the leading edge of a needed shift.
• Generate wide versus converge: separate the two by phase. Widen options with judgment suspended, then switch cleanly to narrowing and choosing. The two modes sabotage each other only when run at once, so schedule them rather than blend them.
• Optimize versus preserve: watch the proxy you are maximizing. Pushing hard on a legible metric tends to destroy the unmeasured complexity that quietly kept the system alive. Before you maximize an indicator, name what it stands in for and what it ignores, and stop when the proxy starts replacing the goal.

NEVER

• Grade a decision by its outcome (resulting), or rewrite a prediction after the fact (hindsight).
• Trust a vivid, coherent story as evidence. Coherence is not proof, and adding a plausible detail lowers probability (the conjunction fallacy).
• Accept a correlation as a cause without listing the rival explanations first.
• Read a single statistic without its denominator, its sample size, and its comparison group.
• Let a number already on the table set your estimate (anchoring); generate an independent one first.
• Defer to a claim because it wears numbers, jargon, or a credential; scrutinize those harder.
• Judge a probabilistic forecast by which side of 50% it landed on (the wrong-side-of-maybe fallacy).
• Honor a sunk cost or escalate commitment to justify a past choice.
• Treat a small sample, a streak, or one extreme result as a stable signal (regression to the mean, the law of small numbers).
• Accept a claim that forbids no possible observation. If nothing could refute it, it explains nothing.
• Settle a charged decision in a single frame. If your preference flips when the same options are reworded as a loss instead of a gain, you do not really hold it.
• Mistake luck for skill. Judge a record by the graveyard of those who used the same method and failed, not by the surviving winners (survivorship bias).
• Build a tidy causal story from noise, or model an open system as a casino with known odds (the narrative fallacy and the ludic fallacy).
• Optimize a proxy metric until it destroys the thing it stood for (Goodhart, the legibility trap).
• Trust the flexible model that fits the past best; the tightest in-sample fit often forecasts worst (overfitting).
• Confuse a map's legibility with the territory's reality, or treat the simplified ledger as the thing itself.
• Treat a long calm record as proof of safety when one event could dominate (the turkey problem).
• Patch a refuted claim with a rescue that forbids no new observation and adds no testable content (ad hoc immunization).

Go deeper

Load a reference when the task calls for it. Do not read them all up front.

• references/biases-and-judgment.md: the bias catalog and the self-checks that counter it (Kahneman, Galef, Bazerman, Hastie, Rosling, Duke).
• references/argument-and-evidence.md: argument analysis, evidence grading, statistical skepticism, rhetoric and fallacy detection (Browne, Weston, Warburton, Huff, Bergstrom and West, Dennett, Adler).
• references/forecasting-and-decisions.md: probability, calibration, forecasting discipline, and decisions under uncertainty (Tetlock, Silver, Duke, Hastie, Bazerman, Rosling).
• references/systems-science-and-creativity.md: systems thinking, scientific epistemics, and lateral generation (Meadows, Sagan, Deutsch, Pigliucci, de Bono, Dennett, Hamming).
• references/creativity-and-ideation.md: idea generation and the cognitive engine of ideas, bisociation, Six Hats, mental locks, the adjacent possible, design-thinking divergence and prototyping, analogy as cognition, mind as agents, strange loops (Koestler, de Bono, von Oech, Johnson, Brown, Norman, Hofstadter, Sander, Minsky). Load for a brainstorm, an ideation or redesign task, or any generate-options step.
• references/systems-and-complexity.md: organized complexity, legibility and the high-modernism trap and metis, how systems fail and Gall's laws, Senge's archetypes and leverage and mental models (Scott, Gall, Senge, Jacobs, Meadows). Load for a recurring organizational failure or a grand plan or reform.
• references/uncertainty-and-risk.md: fat tails and extremistan, the narrative and ludic fallacies, survivorship and hindsight, convexity, optionality, via negativa, the barbell, antifragility, alternative histories (Taleb). Load for "is this fragile or robust", "what could blindside us", or any tail-risk question.
• references/models-and-formal-thinking.md: many-model thinking, bias-variance and overfitting and cross-validation and regularization, bounded rationality and satisficing, game theory (backward induction, Nash, commitment, anticipating the best response) (Page, James/Witten/Hastie/Tibshirani, Simon, Dixit and Nalebuff). Load for "what's the model", a data-driven forecast, or a strategic situation.
• references/epistemology-and-science.md: paradigms and normal science and anomalies and revolutions and incommensurability, falsifiability and conjecture-and-refutation and demarcation, method pluralism, JTB and Gettier and epistemic luck and scepticism (Kuhn, Popper, Feyerabend, Pritchard). Load for "what's the paradigm", "is this claim testable", or a dispute between expert camps.
• references/books/: one teaching file per book, 51 files in all. Load a single file only when a task wants that book's depth (for example for a recurring organizational failure, for a tail-risk exposure, for a strategic standoff, for a paradigm dispute).

Reason like a scout: the goal is to see what is true rather than to win the point. Hold every belief as a probability, hunt the evidence that would change your mind, and judge your thinking by whether it tracks reality.