
Why anything a manager cares about can be measured, and how to measure it.
Calibration and the value of information applied to intangibles.
Hubbard argues that anything a manager cares about can be measured, and that the objection that something is immeasurable rests on three confusions: about what measurement is, about what the object of measurement is, and about the methods available. He defines measurement as a reduction in uncertainty based on observation, expressed as a probability distribution rather than as a point estimate.
The method has several parts. First, define the decision the measurement is meant to inform, since a measurement that cannot change a decision has no value. Second, express current uncertainty as a calibrated probability interval, and Hubbard supplies calibration training exercises showing that most people are badly overconfident and that calibration is a learnable skill. Third, compute the expected value of information for each variable, which usually shows that the variables people want to measure have low information value and that a few overlooked ones dominate. Fourth, measure only those, using the cheapest method that reduces uncertainty, including small samples, decomposition, controlled experiments and Fermi estimation. He is emphatic that small samples carry far more information than people assume, and gives the rule of five, that the median of any population lies between the smallest and largest of five random samples about ninety-four percent of the time.
Hubbard also attacks common alternatives, particularly weighted scoring models and risk matrices, arguing they add noise rather than information. The book is practical and the calibration and expected-value-of-information material is directly usable. Its weakness is that Hubbard's own consulting method is presented as more settled than the evidence supports, and some case results are asserted rather than documented.
Operators and investors who need to quantify supposedly unmeasurable variables before a decision, and who want a working method for calibrated estimation.
“Hubbard, Douglas, How to Measure Anything: Finding the Value of Intangibles in Business (Hoboken, NJ: John Wiley & Sons, 2007)”
Chosen by shared topics, the entries that hold them, and the people who recommended both.
Why some forecasts succeed and most fail, from weather to earthquakes and economics.
“See Gigerenzer, Calculated Risks, 28-29. 14 For a book that treats this topic and more, see Annie Duke, Thinking in Bets: Making Smarter Decisions When You Don't Have All the Facts (New York: Portfolio/Penguin, 2018). 15 For a good discussion of Bayes’ Theorem, see Nate Silver, The Signal and the Noise: Why So Many Predictions Fail—But Some Don’t (New York, The Penguin Press, 2012), 232-261.” — Michael Mauboussin
Source: Confidence: Methods to Assess Confidence Under Uncertainty, page 7
Recommended by: Bill Gates, Michael Mauboussin and 2 others
What a four-year forecasting tournament showed about the best forecasters' habits.
“In a book many in our research department have enjoyed, Superforecasting: The Art and Science of Prediction, Philip Tetlock and Dan Gardner state: “The humility required for good judgment is not self-doubt—the sense that you are untalented, unintelligent, or unworthy.” — Bill Nygren
Source: Bill Nygren Market Commentary | 1Q17
Recommended by: Bill Nygren, Mark Leonard and 11 others
A 20-year test of 28,000 expert forecasts: foxes with many models beat hedgehogs.
“All pundits and commentators should publish their prediction track records, yet don't. What to pay attention to and what to ignore.” — Marc Andreessen
Source: @pmarca, 'Thread: Books I've recently read and recommend'
Recommended by: Marc Andreessen, Michael Mauboussin and 2 others
Whether clinical judgement or statistical formulas predict better in psychology.
“Paul E. Meehl, Clinical versus Statistical Prediction: A Theoretical Analysis and a Review of the Evidence (Minneapolis, MN: University of Minnesota Press, 1954)” — Michael Mauboussin
Source: BIN There, Done That: How to Reduce the Sources of Forecasting Error, page 14
Recommended by: Michael Mauboussin, Daniel Kahneman
How randomness shapes our lives, the history of probability, and why we misread it.
“I thought it was about the philosophy of randomness, but turned out to be about the math of probability. Might read again some day when in the mood for that.” — Derek Sivers
Source: Derek Sivers book notes (primary, rated list) · Rating: 3/10
Recommended by: Derek Sivers, Michael Mauboussin and 1 other
About thirty formal models: what each explains and where each fails.
“Scott E. Page, The Model Thinker: What You Need to Know to Make Data Work for You (New York: Basic Books, 2018), 27-42” — Michael Mauboussin
Source: BIN There, Done That: How to Reduce the Sources of Forecasting Error, page 14
Recommended by: Michael Mauboussin, Keith Rabois
As an Amazon Associate I earn from qualifying purchases.