Kurzweil's optimistic counterpoint to the safety literature. His law of accelerating returns and the vision of intelligence explosion as fundamentally benign is the premise that alignment researchers are most directly arguing against. Reading it gives the other side of the debate its strongest formulation.
Kurzweil argues that technological progress is exponential rather than linear, that this pattern holds across multiple technologies over long periods, and that extrapolating it produces a point around 2045 where machine intelligence exceeds all human intelligence combined and the pace of change becomes incomprehensible from the current vantage point.
His central evidence is the law of accelerating returns, which he supports with plotted data on computing price-performance across mechanical, relay, vacuum tube, transistor and integrated circuit technologies, arguing that the exponential trend predates and will outlast any specific technology including silicon. He extends the argument to genome sequencing costs, brain scanning resolution, and communication bandwidth.
His specific predictions include computers passing the Turing test by 2029, molecular manufacturing, the reverse engineering of the brain enabling whole brain emulation, the merging of biological and non-biological intelligence through nanoscale devices, and eventual radical life extension. He addresses the three overlapping revolutions of genetics, nanotechnology and robotics, and devotes a chapter to the risks including self-replicating nanotechnology and hostile artificial intelligence.
The criticisms are substantial. Exponential trends in specific technologies have repeatedly stalled, and Moore's law has slowed considerably since publication. Kurzweil's method of plotting heterogeneous data on log scales has been criticised as producing the trend it claims to find. The molecular manufacturing predictions have not materialised at all. His record on the artificial intelligence predictions has been better than most critics expected, particularly on language capability, though the mechanism differs entirely from what he described. Read it for the argument about exponential extrapolation, with the specific timelines checked against what happened.
Investors and founders in technology who want the fullest statement of the exponential extrapolation argument, checked against two decades of subsequent evidence.
Chosen by shared topics, the entries that hold them, and the people who recommended both.
