
The mathematics of fat-tailed distributions and what they do to statistics.
Technical companion to the Incerto; free preprint on arXiv
Taleb wrote this as a technical companion to his non-technical books, assembling the mathematical arguments about probability distributions with infinite or very large higher moments. It is written for readers with a working knowledge of probability and statistics.
The central technical point is that under fat-tailed distributions, the standard statistical apparatus produces answers that do not mean what they appear to mean. The law of large numbers still holds under conditions but converges far more slowly, so sample sizes adequate for a Gaussian distribution are inadequate here. The sample mean is not a reliable estimator when the variance is infinite or very large. Correlation and regression become unstable because they depend on second moments. Standard deviation is not a measure of dispersion for such distributions and its use is, in Taleb's view, the profession's most consequential error. Principal component analysis and other techniques resting on covariance matrices inherit the problem.
He develops the distinction between what he calls Mediocristan, where no single observation moves the aggregate, and Extremistan, where one can dominate the entire sample, and shows how to detect which regime a dataset comes from by examining how the maximum observation's share of the total behaves as the sample grows.
Applications covered include the estimation of tail exponents, the shadow mean for bounded observed data, the statistics of violent conflict, pandemics, income distribution and financial returns. He also attacks specific empirical literatures, including some of behavioural economics and some risk management practice, for applying thin-tailed methods to fat-tailed data.
The book is combative and disorganised, assembled from papers and lecture notes with substantial repetition. Statisticians accept much of the technical content, which is not original to Taleb, while disputing his claim that the profession is unaware of it. It is not an introduction and requires mathematical preparation.
Quantitatively trained readers in finance and risk who need the technical statement of why standard statistical methods fail on financial and extreme-event data.
Former options trader; Distinguished Professor of Risk Engineering, NYU Tandon; scientific adviser to Universa Investments
The Incerto is the primary source for how markets and institutions handle tail risk, and the accompanying technical work supplies the mathematics others cite.
Chosen by shared topics, the entries that hold them, and the people who recommended both.
Rare, unforeseen, high-impact events drive history, explained only after the fact.
“The Black Swan U The best-known bird around today is The Black Swan, the second book from Nassim Nicolas Taleb.” — Howard Marks
Source: The Complete Collection, page 530
Recommended by: David Perell, Howard Marks, Marc Andreessen and 20 others
Why standard finance models understate market risk, from fractal geometry's creator.
“(Italics added.) Mandelbrot on Risk, Ruin, and Reward The abstract theories of Karl Popper and Frank Knight can be directly applied to the financial markets, which is exactly what Benoit Mandelbrot, the brilliant inventor of fractal geometry, has done with Richard Hudson in his book The (Mis)Behavior of Markets, ominously subtitled “A Fractal View of Risk, Ruin, and Reward.” — John C. Bogle
Source: Black Monday and Black Swans, page 3
Recommended by: John C. Bogle, Mohnish Pabrai and 2 others
Self-organised criticality: why earthquakes and crashes come in all sizes.
“Mark Buchanan, Ubiquity: The Science of History . . . Or Why the World is Simpler Than We Think (New York: Crown Publishers, 2000)” — Michael Mauboussin
Source: Interdisciplinary Perspectives on Risk, page 5
Recommended by: Michael Mauboussin
Why some things gain from volatility and disorder, and how to build them.
“Antifragile. Loved the first 1/3 and last 1/3 of this book.” — Andrew Chen
Source: Books I’m reading (2013)
Recommended by: Ana Fabrega, Andrew Chen, Derek Sivers and 24 others
Why people mistake luck for skill, above all in markets.
“Fooled By Randomness was unquestionably the best non-fiction book I read in 2005.” — Brad Feld
Source: Book Review: Fooled By Randomness — Feld Thoughts
Recommended by: Barton Biggs, Brad Feld, Derek Sivers and 15 others
A graduate text on power laws, fractals and critical points in complex systems.
Recommended by: Nassim Nicholas Taleb