| name | tufte-graphical-integrity |
| description | Apply Tufte's six principles of graphical integrity and the Lie Factor to detect, measure, and eliminate distortion in data graphics — use when designing, reviewing, or auditing any chart for truthfulness. |
| tags | ["tufte","data-visualization","graphical-integrity","lie-factor","statistical-graphics"] |
Graphical Integrity
Overview
A graphic has integrity when the physical size of the marks on its surface is directly proportional to the numbers they stand for. Most distortions are not random: they systematically exaggerate the magnitude of recent change. Tufte's contribution is to make distortion measurable — the Lie Factor turns "this chart feels misleading" into a number you can compute and defend.
Sourcing note. The only two Lie Factors below that Tufte himself computes and publishes in VDQI Ch. 2 are the fuel-economy graphic (14.8) and the shrinking-doctors graphic (2.8). Every other numeric figure in this skill is an illustrative derivation of the stated mechanism, labeled as such — never cite it as a Tufte-stated value. This is the integrity discipline the skill teaches, applied to the skill itself.
§1. The Lie Factor
The single measurement that converts opinion into evidence:
Lie Factor = (size of the effect shown in the graphic) / (size of the effect in the data)
"Size of effect" is a percentage change: (later − earlier) / earlier × 100. Compute it once for the data, once for the printed marks (line lengths, bar heights, icon areas), then divide.
Thresholds:
| Lie Factor | Verdict | Action |
|---|
| 0.95 – 1.05 | Acceptable — ordinary plotting error only | Ship |
| < 0.95 | Understates — graphic shrinks the real effect | Rescale to proportional |
| > 1.05 | Overstates — distortion beyond plotting error | Rescale to proportional |
| 2 – 5 | Common range for published newspaper graphics | Treat as a red flag, recompute |
| > 10 | Extreme — the graphic falsifies the news in the data | Reject and redraw |
- Tufte sets the honest band at 0.95–1.05; anything outside is distortion, not rounding.
- Distortion is almost always one-directional (overstating), and Lie Factors of 2 to 5 show up routinely in the popular press.
- To compare an overstatement against an understatement on equal footing, compare the logarithms of the Lie Factors — a 2× overstatement and a 0.5× understatement are equal in magnitude, opposite in sign.
Worked example — Fuel Economy Standards (NYT, 1978), Tufte's own computation:
| Quantity | Value |
|---|
| Data: standard rises 18 mpg (1978) → 27.5 mpg (1985) | (27.5 − 18.0)/18.0 = +53% |
| Graphic: line drawn 0.6 in (1978) → 5.3 in (1985) | (5.3 − 0.6)/0.6 = +783% |
| Lie Factor | 783 / 53 = 14.8 |
The road also recedes toward a vanishing point, so the receding-line distortion and the data change are visually inseparable, and the date labels shrink with perspective while the data does not.
§2. The Six Principles of Graphical Integrity
Tufte's closing checklist for the chapter. Each principle names a class of lie it forbids.
| # | Principle (paraphrased) | What it rules out |
|---|
| 1 | Marks on the surface must be proportional to the quantities they represent. | Scaled pictograms, perspective foreshortening, truncated baselines used to steepen slopes |
| 2 | Use clear, detailed labeling to defeat ambiguity; write explanations and annotate key events on the graphic itself. | Unlabeled axes, missing units, unmarked index base, no annotation of causes |
| 3 | Show data variation, not design variation. | Mid-chart scale changes, irregular intervals, shifting canvas size or aspect ratio |
| 4 | For money over time, deflated and standardized units beat nominal units. | Nominal-dollar charts that look like a boom but are flat in real per-capita terms |
| 5 | Information-carrying (varying) dimensions must not exceed the dimensions in the data. | 2-D or 3-D icons (barrels, figures, dollar bills) used for a single scalar |
| 6 | Graphics must not quote data out of context. | Before/after charts that hide the surrounding trend; comparisons that omit control groups |
Three of these are quotable verbatim and are worth memorizing as test questions to run against any chart:
"Show data variation, not design variation." — Tufte, VDQI
"Graphics must not quote data out of context." — Tufte, VDQI
"In time-series displays of money, deflated and standardized units of monetary measurement are nearly always better than nominal units." — Tufte, VDQI
§3. Named Failure Modes — Detection Catalog
Six recurring ways a graphic lies. For each: the cue that exposes it, and the principle it breaks.
| Failure mode | Visible cue | Principle broken | How to measure it |
|---|
| Perspective / receding baseline | Lines or bars drawn in 3-D depth or toward a vanishing point | 1 | Measure printed length, compute Lie Factor |
| Dimension inflation | A scalar shown by an icon's area or volume (height + width both vary) | 5 | Compare area/volume ratio to data ratio (§4) |
| Design variation as data variation | Scale or interval changes across one chart; tall/thin canvas | 3 | Check that one data unit = one constant printed size everywhere |
| Nominal money illusion | Dollar amounts over years with no "constant $" or "per capita" note | 4 | Re-plot deflated and per-capita (§6) |
| Out-of-context quoting | Two data points, or one group, with no surrounding series | 6 | Extend the series; add control groups (§7) |
| Stripped labeling | Bare numbers, no units, no index base, no source | 2 | Restore units, base year, source, event annotations |
Tufte's two published Lie Factors (the only source-stated figures):
- Fuel Economy Standards (NYT, 1978) — Lie Factor 14.8. Receding-road line lengths; see §1. Mode: perspective baseline.
- The Shrinking Family Doctor (LA Times, 1979) — Lie Factor 2.8. Share of family-practice doctors falls from 27% (1964) to 12% (1990); the human figures shrink far more than the percentages do, and the 2.8 is before counting extra distortion from perspective and uneven spacing of the years. Mode: dimension inflation (a 2-D figure for a 1-D percentage).
§4. Proportional Representation: the Dimension Trap
One-dimensional data must be drawn with one-dimensional ink — length or position on a common scale. Encoding a scalar as area or volume introduces two stacked errors:
- Geometric amplification. If a value changes by ratio r, an area built by scaling both sides changes by r², and a volume by r³. The lie grows by the square or cube of the intended change.
- Perceptual under-reading. People do not mentally convert perceived area or volume back to the correct linear value, so even a "correctly scaled" area chart is misread.
Worked illustration (derived from the mechanism — not a Tufte-stated figure):
| Encoding of a value that doubles (+100%) | What the eye reads | Lie Factor |
|---|
| Length only (bar / line on common scale) | +100% | 1.0 — honest |
| Icon with both width and height doubled | area 2×2 = +300% | 3.0 |
| 3-D icon read as volume | 2×2×2 = +700% | 7.0 |
Same datum, no change in the number — the distortion comes purely from the spare dimensions. This is why barrels, shrinking dollar bills, and human figures lie even when the artist scales them "to proportion."
Do / don't:
| Do | Don't |
|---|
| Encode 1-D data with bar length or dot position on a common, zero-based scale | Encode 1-D data with circle area, icon height + width, or 3-D volume |
| If a symbol must be scaled, vary one dimension only | Vary both width and height in response to a single number |
| If circles are unavoidable, scale by area to the data (not radius) and print the value | Let readers infer magnitude from an unlabeled area or volume |
| Use a flat, 2-D bar chart | Add perspective depth that creates false foreshortening |
§5. Design Variation vs. Data Variation
The subtlest lie: the canvas itself changes across the graphic, so the eye attributes layout changes to the data. The remedy is a stable, uniform frame — one data unit occupies the same printed size everywhere on the surface.
| Design-variation type | Mechanism | Cue to catch it | Fix |
|---|
| Mid-chart scale change | Same quantity occupies different printed sizes by position | Two y-axes, or a scale break with no zigzag mark | One scale, full range |
| Non-uniform time axis | Recent intervals compressed or stretched vs. history | Unequal gaps between equal time steps | Equal pixels per equal time unit |
| Shifting aspect ratio | A tall, narrow canvas exaggerates apparent slope | Frame much taller than wide | Neutral aspect (often near the "banking to 45°" angle) |
| Perspective recession | Depth shrinkage and data change become inseparable | 3-D scene, vanishing point | Flatten to 2-D |
Do / don't:
| Do | Don't |
|---|
| Keep one continuous scale across the whole frame | Switch scales partway, or stack two incompatible scales |
| Space equal time steps with equal width | Compress the most recent interval to manufacture a trend |
| Hold the aspect ratio constant when comparing charts | Stretch one chart vertically to dramatize its rise |
§6. Money Over Time: Deflate and Standardize
Nominal-dollar time series almost always overstate real growth, because the dollar's value and the population both drift underneath the numbers.
| Adjustment | Why it matters | What it exposes |
|---|
| Deflate for inflation | Nominal dollars conflate price level with real quantity | A "rising" budget can be flat or falling in constant dollars |
| Standardize per capita | Population growth inflates any aggregate total | Per-person spending often grows far less than the total |
| Neutralize aspect ratio | A tall canvas exaggerates the climb | The real slope, neither steepened nor flattened |
Pattern to watch: a nominal chart shows steep continuous growth; after deflating and dividing by population, the same series turns flat — sometimes into an outright real-terms cut. The actual news (the decline) was invisible in nominal units. Always state on the graphic whether dollars are nominal or real, and which base year the deflator uses.
§7. Context: "Compared to What?"
A graphic answers a question, and the question is always compared to what? A chart that cannot answer comparisons lies by omission. Sparse, data-thin graphics should raise suspicion, not trust.
Context checklist:
| Question | What it rules out |
|---|
| What was the trend before the intervention? | Mistaking normal variation or regression-to-the-mean for an effect |
| What happened after? | Mistaking a one-year blip for a lasting change |
| What happened to comparable groups? | Mistaking a region-wide trend for a local cause |
| Is the baseline year cherry-picked? | An anomalous "before" that makes any "after" look dramatic |
Connecticut traffic-deaths pattern — three framings of the same data:
| Data shown | Apparent conclusion | Honest? |
|---|
| Two years (before / after a speeding crackdown) | The crackdown caused a dramatic drop | No — single comparison |
| The full multi-year series | The drop sits within normal year-to-year swings | Closer |
| The full series plus neighboring states | All states fell together; no unique local effect | Yes — context restored |
§8. Labeling as the Reader's Only Defense
Labels are not decoration. They are the one check a reader has against a chart that might be lying, and Tufte treats thorough, on-graphic labeling as the primary weapon against distortion.
| Do | Don't |
|---|
| Put the unit of measurement on every axis | Leave bare numbers with no unit |
| Spell out the index base (e.g., "1972 = 100") | Bury the base in a footnote or omit it |
| Annotate key events (wars, policy changes, recessions) directly on the chart | Let readers guess the cause of an inflection |
| State plainly whether dollars are nominal or real | Default to nominal and let readers assume real |
| Print the data source on the graphic | Hide attribution in a distant caption |
§9. The "It Shows the Right Direction" Defense
The standard rationalization for a lying graphic is: "It's roughly right — we only wanted to show the general direction of change." This treats data as merely ordinal (bigger/smaller) while attaching invented magnitudes.
It does not hold:
- A Lie Factor of 14.8 is not "roughly right." Direction is the cheapest, least informative part of the message.
- When distortion reverses the story — a real-terms budget cut drawn as a boom — even the direction is wrong.
- Numbers carry magnitude, not just order. A graphic that preserves only direction has discarded most of the information and kept the part a single sentence could have stated.
Getting the arrow to point the right way is never a defense for fabricating how far it points.
§10. Quick-Reference Audit Protocol
Run this before publishing or signing off on any data graphic. Each failure raises the odds of a Lie Factor outside 0.95–1.05 and should trigger an explicit calculation.
[ ] Lie Factor computed (graphic effect / data effect). Within 0.95–1.05?
[ ] One continuous scale across the whole frame? No mid-chart breaks or twin axes?
[ ] Equal time steps drawn with equal width?
[ ] Visual dimensions ≤ data dimensions? (1-D data → length/position, never area/volume)
[ ] No perspective, depth, or receding baseline distorting the marks?
[ ] Money deflated to constant dollars and per-capita where population moved?
[ ] Every axis, unit, and index base labeled? Source printed on the graphic?
[ ] Key events annotated directly on the chart?
[ ] Enough surrounding series and control groups to answer "compared to what?"
[ ] Aspect ratio neutral — neither steepening nor flattening the real slope?
If any box is unchecked, do not assume dishonesty — compute the Lie Factor and decide on the number, not the impression.
