
Why expert predictions fail so often, and why people keep believing them.
Gardner examines why expert predictions fail so consistently and why people continue to seek and believe them. His empirical foundation is Philip Tetlock's twenty-year study, which collected over eighty thousand forecasts from nearly three hundred experts and found their accuracy barely better than chance and worse than simple extrapolation rules.
Tetlock's most useful finding, which Gardner develops, is that a forecaster's field, experience and access to information predicted accuracy poorly, while their cognitive style predicted it well. Experts Tetlock classified as hedgehogs, meaning those who apply one organising framework to everything, performed worse than those classified as foxes, meaning those who use many partial frameworks, tolerate contradiction and adjust. Hedgehogs also attracted more media attention, because a single confident framework produces the definite statements broadcasting wants.
Gardner covers the psychology of why prediction fails: the illusion of control, hindsight bias which erases our memory of having been wrong, confirmation, and the human intolerance of uncertainty, which he argues is the demand side of the prediction industry. He documents specific failed forecasts across resource depletion, population, oil prices, geopolitics and economics, including the ones that made their authors famous.
His conclusion is that the correct response to an unpredictable future is not better forecasting but preparation that does not depend on any particular outcome. The book is journalism synthesising Tetlock's research rather than original work, and readers wanting the research itself should read Expert Political Judgment or Superforecasting.
Investors and executives who rely on forecasts and want the evidence on their accuracy and on which forecasters are worth reading.
Canadian journalist who co-wrote Superforecasting with Philip Tetlock and How Big Things Get Done with Bent Flyvbjerg.
Superforecasting reports the Good Judgment Project tournament results and the habits that separated accurate forecasters: breaking questions into parts, updating in small increments, keeping score in numbers. How Big Things Get Done adds base-rate evidence from thousands of megaprojects on why budgets and schedules fail and what the successful ones did differently.
Chosen by shared topics, the entries that hold them, and the people who recommended both.
What a four-year forecasting tournament showed about the best forecasters' habits.
“In a book many in our research department have enjoyed, Superforecasting: The Art and Science of Prediction, Philip Tetlock and Dan Gardner state: “The humility required for good judgment is not self-doubt—the sense that you are untalented, unintelligent, or unworthy.” — Bill Nygren
Source: Bill Nygren Market Commentary | 1Q17
Recommended by: Bill Nygren, Mark Leonard and 11 others
What 16,000 projects show about why big ones overrun, and how to plan them.
“Bent Flyvbjerg and Dan Gardner, How Big Things Get Done: The Surprising Factors That Determine the Fate of Every Project, from Home Renovations to Space Exploration and Everything In Between (New York: Crown Currency, 2023)” — Michael Mauboussin
Source: Pattern Recognition: Opportunities and Limits, page 14
Recommended by: Michael Mauboussin
Principles of observation, inference and avoiding error, from the Holmes stories.
Recommended by: Mohnish Pabrai, Patrick O'Shaughnessy and 1 other
Munger's and Buffett's ideas on avoiding error, as a dialogue built from their words.
Why aviation learns from every failure while fields like medicine hide theirs.
Recommended by: Richard Branson, Daniel Ek
How snap judgments work, when to trust them and when they mislead.
“Malcolm Gladwell, Blink: The Power of Thinking Without Thinking (New York: Little, Brown and Company, 2005)” — Michael Mauboussin
Source: Are You an Expert? Experts and Markets, page 9
Recommended by: Michael Mauboussin, Mohnish Pabrai and 2 others