The Investor's Shelf — one book
Black Box Thinking

Black Box Thinking

Matthew Syed
2015
T4 322 pages · about 5h 22m to read OL20021353Wgoodreads

Summary

Syed contrasts two professional cultures. Aviation investigates every accident and near miss through an independent body, publishes the findings, and requires that the resulting changes be adopted across the industry, with data from every flight recorded automatically. Healthcare, by contrast, treats errors as individual failures, conceals them under litigation exposure, and does not systematically collect or share the information that would prevent repetition.

His argument is that the difference in outcomes follows from the difference in how failure is treated, and that the aviation approach is available to any field that chooses it. The supporting material covers specific aviation cases including United 173, which ran out of fuel while the crew addressed a landing gear problem and which produced crew resource management training, and specific medical cases including the death of Elaine Bromiley during a routine procedure, investigated by her husband, an airline pilot.

He extends the argument to criminal justice, where he documents prosecutors refusing to accept DNA exonerations because accepting them requires accepting that they convicted an innocent person, and to business, where he covers randomised testing, marginal gains in cycling under Dave Brailsford, and the difference between organisations that run experiments and those that rely on the judgment of senior people.

His general claim is that a closed loop, in which failure is explained away rather than investigated, is what prevents learning, and that the explanation is usually available and psychologically comfortable. The cognitive dissonance material overlaps heavily with Tavris and Aronson. Syed is a journalist and the cases are selected. The aviation and healthcare comparison is the strongest evidence and is well documented.

Key takeaways 8

  1. Aviation investigates every accident and near miss through an independent body, publishes the findings, and requires industry-wide adoption of the changes.
  2. Healthcare treats errors as individual failures, conceals them under litigation exposure, and does not systematically collect the information that would prevent repetition.
  3. The difference in safety outcomes between the two fields follows from how failure is treated rather than from any difference in the difficulty of the work.
  4. A closed loop, in which failure is explained away rather than investigated, is what prevents learning, and the explanation is always available.
  5. Professionals resist acknowledging error because their identity and their institution depend on their judgment being reliable.
  6. Prosecutors refuse to accept DNA exonerations because accepting them requires accepting that they convicted an innocent person.
  7. Randomised testing produces information that the judgment of senior people does not, which is why organisations that test outperform those that decide.
  8. Accumulated small improvements, each individually trivial, produce large aggregate gains where the measurement system can detect them.

Who should read it

Leaders designing how their organisation handles failure, wanting the aviation comparison and the specific mechanisms that make investigation work.

Where it sits in the reference 3

Philosophy
Mental models
Mental models

Who recommended it 2 · 1 direct

70 must-read books — Richard Branson's blog, Virgin.com
Daniel Ekreported
Book recommendations listed on their Good Books profile · aggregator only

Similar books 6

Chosen by shared topics, the entries that hold them, and the people who recommended both.

Thinking, Fast and Slow
Thinking, Fast and SlowDaniel Kahneman
Fooled by Randomness
Fooled by RandomnessNassim Nicholas Taleb
Groupthink
GroupthinkIrving L. Janis
Seeking Wisdom: From Darwin to Munger
Seeking Wisdom: From Darwin to MungerPeter Bevelin
Superforecasting
SuperforecastingPhilip E. Tetlock, Dan Gardner
Expert Political Judgment
Expert Political JudgmentPhilip E. Tetlock