Heuristics, Biases & Rationality

The program

The shortcuts we think with

In 1974, two Israeli psychologists published a paper in Science that quietly rerouted a field. Tversky and Kahneman argued that people do not estimate probabilities by doing probability. Instead we reach for a handful of heuristics: fast mental shortcuts that usually work and occasionally fail in predictable ways. Three did most of the heavy lifting.

Representativeness. We judge how likely something is by how much it resembles our mental prototype. This is exactly what snares Linda: she resembles the stereotype of a feminist so strongly that “feminist bank teller” feels like a better fit than plain “bank teller,” and the feeling of fit quietly overrides the arithmetic of sets. Representativeness also makes us ignore base rates, the trap from Day 4: told that “Steve is meek and tidy and likes order,” people guess librarian over farmer, forgetting that there are vastly more farmers than librarians to begin with.

Availability. We judge how common something is by how easily examples come to mind. After a plane crash leads the news, flying feels lethal, even though the very newsworthiness of the crash is evidence of how rare it is. Vivid, recent, emotional events are overweighted because they are easy to recall.

Anchoring and adjustment. When we estimate an unknown number, we latch onto whatever value is nearby and adjust from it, usually not far enough. Tversky and Kahneman spun a rigged wheel of fortune, let it stop on 10 or 65, then asked people what percentage of African nations are in the UN. Those who saw 65 guessed far higher than those who saw 10. The wheel was obviously random and had nothing to do with Africa. It anchored them anyway.

The unsettling part is not that we err. It is that these errors are as stubborn as optical illusions. In the Muller-Lyer illusion, two lines of equal length look unequal because of little arrowheads on their ends, and knowing the trick does not make them look equal. Kahneman’s claim was that many cognitive biases are like that: not ignorance, but the automatic output of machinery you cannot simply switch off. Understanding the fallacy does not dissolve the feeling. Kahneman won the 2002 Nobel in Economics for this line of work; Tversky, who died in 1996, would surely have shared it, but the prize is not given posthumously.

The model — and its cracks

Fast and slow, handled carefully

To organize all this, Kahneman popularized a two-character drama in his 2011 bestseller Thinking, Fast and Slow. System 1 is fast, automatic, effortless, intuitive: it reads the word on a billboard, senses hostility in a voice, and blurts “feminist” at Linda before you have noticed. System 2 is slow, deliberate, effortful: it is what you use to fill out a tax form or check whether B is really a subset of A. Biases, on this telling, happen when busy System 2 fails to audit the quick answer.

It is a wonderful teaching device. It is also, taken literally, probably wrong, and the field knows it. Three cracks are worth naming, because a good scientist keeps the ladder and kicks away the scaffolding.

There may not be two of anything. The “two systems” were always more metaphor than anatomy. Even leading proponents retreated: Jonathan Evans and Keith Stanovich, in a careful 2013 paper, abandoned the idea of two systems in favor of two types of processing, a weaker and fuzzier claim. In 2018 David Melnikoff and John Bargh went further, calling the dual-process typology “a convenient and seductive myth” that “lacks empirical support” and “systematically thwart[s] scientific progress.” The tidy binary, conscious/unconscious and effortful/automatic, does not cluster into two neat bundles.

The mental-fuel tank was a mirage. A famous companion idea, ego depletion, held that effortful self-control runs on a limited energy reserve: resist the cookies now, and you will cave to the next temptation because your willpower muscle is tired. It launched a thousand studies. Then, in 2016, a preregistered replication across 23 laboratories found the effect was essentially zero: a standardized effect size of about 0.04, statistically indistinguishable from nothing. This is the Day 2 replication crisis reaching into today’s topic. One of the marquee findings behind effortful System 2 evaporated when tested rigorously.

So hold the model loosely. Fast versus slow remains a useful shorthand, and we will keep using it, but treat it the way Day 10 taught us to treat any model: a lossy map, not the territory. The deeper action has moved elsewhere.

The debate

The Great Rationality War

Here is where the field split into two camps that have argued, productively and pointedly, for four decades.

On one side stands the heuristics-and-biases tradition of Kahneman and Tversky. Its message, roughly: human intuition is riddled with systematic error. Biases are cognitive illusions, real measurable failures against the gold standard of logic and probability. The practical upshot is meliorist: since our minds mislead us, we should build corrections such as training, checklists, expert systems, and later, nudges.

On the other side stands Gerd Gigerenzer and the ABC Research Group in Berlin, who reply: not so fast. The “errors,” they argue, are often not errors at all, and the experiments are frequently rigged, unintentionally, against the humans. They make two distinct moves, and it is worth keeping them apart.

Move one: change the format, and the fallacy fades

Gigerenzer’s first argument is about information format, a direct callback to Day 7. The same content can carry very different amounts of usable structure depending on how it is encoded. Take the base-rate problems that make people, and doctors, look hopeless. In probability format:

A disease affects 1% of women. A test detects it 90% of the time, but also gives a false positive 9% of the time. A woman tests positive. How likely is it that she is actually sick?

Most people, including many physicians in study after study, answer around 80-90%. The correct answer is about 9%. But watch what happens when you hand the mind the same facts as natural frequencies instead of abstract percentages: Of 1,000 women, 10 have the disease and 9 of them test positive. Of the 990 healthy women, about 89 also test positive. So of roughly 98 women who test positive, only 9 are sick. Suddenly the answer, 9 out of 98, about 1 in 11, is almost visible. You can count it. A 2017 meta-analysis found that switching to natural frequencies roughly quintupled correct Bayesian answers, from about 4% to about 24% of people. Gigerenzer’s point is that the base-rate fallacy is not just a fixed flaw in human wiring. It is partly an artifact of feeding the mind single-event probabilities, a format it is poorly built to digest. Change the representation and much of the irrationality dissolves.

Move two: less can be more

Gigerenzer’s second, bolder argument is that simple heuristics are not merely excusable. They are sometimes better than the fancy, information-hungry methods statisticians prefer. The banner is fast-and-frugal heuristics: little rules that ignore most of the available information and still make excellent decisions.

The showpiece is the gaze heuristic. How does an outfielder catch a fly ball? Not by measuring velocity, computing a parabola, and sprinting to where the ball will land. That is intractable in real time with wind and spin. Instead the fielder fixes their gaze on the ball and runs so that the angle of gaze stays constant. Follow that one rule and you arrive where the ball comes down, no calculus required. The heuristic works not despite ignoring information but because it does: it throws away everything except the single cue that matters.

Or the recognition heuristic: asked which of two cities is larger, if you recognize one and not the other, bet on the one you recognize. Absurdly crude, and yet, because recognition tends to track size, it can beat elaborate models. In a celebrated finding, this even produced a “less-is-more effect”: people who recognized fewer of the cities sometimes scored better, because they could use the heuristic while those who recognized everything had to fall back on shakier knowledge.

Why would ignoring information ever help? The deep answer, which Gigerenzer and Henry Brighton laid out in a 2009 paper titled Homo Heuristicus, is the bias-variance tradeoff, an idea we will meet again in machine learning on Day 136. A complex model with many parameters fits the data it trained on beautifully, but it also fits the noise, so it lurches around on new data. A simple heuristic cannot fit noise because it barely fits anything. It may be biased, but it is stable, and in a noisy, small-sample world, stability often wins.

The reframe

Simon’s scissors

Underneath the whole fight is a question about the yardstick. When Kahneman says people are irrational, he means: measured against the laws of logic and probability. When Gigerenzer says they are smart, he means: measured against success in the actual environment they live in. These are different rulers, and much of the war is a disagreement about which ruler is legitimate.

The person who saw this first was Herbert Simon: economist, cognitive scientist, AI pioneer, and winner of the 1978 Nobel. Simon spent the 1950s arguing that the fantasy of a perfectly rational agent who optimizes over all options is a nonstarter for any real creature. Real minds have limited time, memory, and attention. So instead of optimizing, we satisfice: we search until we find an option that is good enough and stop. Simon called this bounded rationality, and he gave it an image that quietly settles the debate:

“Human rational behavior is shaped by a scissors whose two blades are the structure of task environments and the computational capabilities of the actor.” Simon, 1990.

A pair of scissors cuts only when both blades engage. You cannot judge a blade on its own. Kahneman and Tversky studied mostly the mind blade, and, holding it up against the ruler of logic, found it wanting. Gigerenzer insists you must look at both blades together: the mind and the world it is cutting through. Once you do, yesterday’s “bias” often reveals itself as a tool matched to its environment. Neither camp is simply wrong. They are inspecting different blades of the same scissors.

Open questions

What’s genuinely unsettled

Fifty years into the study of how minds actually reason, the honest ledger is still long:

• Is there one correct standard of rationality at all? Or is “rational” always relative to a goal and an environment?
• One process or many? Is the mind a single engine doing approximate inference under a budget, or are there genuinely distinct modes? The two-systems picture is wounded, but no agreed replacement has won.
• Are biases to be corrected or respected? If a bias is the optimal output of a bounded mind, debiasing it might make you worse in the real world while better on a logic test.
• Does resource-rationality explain, or merely redescribe? Can it be made falsifiable, or will it always find a cost function that excuses whatever people did?
• And the question the AI block inherits: when a system reproduces our fallacies, has it learned our reasoning, or only our residue?