The Investor's Shelf — one book
Broken Code

Broken Code

Jeff Horwitz
2023
T3 OL35725751Wgoodreads

Built on the Facebook Files documents leaked by Frances Haugen.

Summary

Horwitz is the Wall Street Journal reporter who received and published the internal Facebook documents that became known as the Facebook Files, working with the whistleblower Frances Haugen. This book presents the wider reporting.

The documents are internal research, and their significance is that they show what the company's own researchers found. Instagram's effect on teenage girls' body image was studied internally with results the company did not publish. The 2018 change to the News Feed ranking algorithm, presented publicly as prioritising meaningful social interaction, increased the reach of divisive and outrage-driven content because those posts generated the engagement signals the new ranking rewarded, and internal researchers documented this and proposed changes that were not adopted. The company operated a programme called XCheck that exempted millions of high-profile accounts from ordinary enforcement. Content moderation resources were concentrated overwhelmingly in English and in the United States while the majority of users and the highest-risk situations were elsewhere, including in Ethiopia, Myanmar and India. Human trafficking and cartel activity on the platform were documented internally.

Horwitz's analytical argument is that the failures were not the result of ignorance or of incompetent research. The company employed capable researchers who identified the problems accurately, and the findings were repeatedly not acted on where acting would have reduced engagement or growth.

Meta disputed the characterisation of the documents and argued that the research was being read selectively. The book is journalism built on internal material and on interviews with current and former staff, and it argues a position. The specific finding, that a ranking change intended to increase meaningful interaction increased the reach of outrage content, is the most consequential and is documented directly.

Key takeaways 7

  1. Facebook's own researchers identified the platform's harms accurately, and the findings were repeatedly not acted on.
  2. The 2018 ranking change intended to prioritise meaningful social interaction increased the reach of divisive and outrage-driven content.
  3. Engagement-based ranking rewards content that provokes reaction, which is a structural property rather than a tuning error.
  4. The XCheck programme exempted millions of high-profile accounts from the enforcement applied to everyone else.
  5. Content moderation resources were concentrated in English and in the United States while the highest-risk situations were elsewhere.
  6. Internal research on Instagram's effect on teenage girls was conducted and not published.
  7. Proposals from internal researchers that would have reduced harm were rejected where they would also have reduced engagement.

Who should read it

Operators and investors in platforms who need the documented case that engagement optimisation produces harms the operator's own research identifies.

Where it sits in the reference 2

Companies
Biographies

Similar books 6

Chosen by shared topics, the entries that hold them, and the people who recommended both.

Careless People
Careless PeopleSarah Wynn-Williams
Facebook
FacebookSteven Levy
The Accidental Billionaires
The Accidental BillionairesBen Mezrich
The Facebook Effect
The Facebook EffectDavid Kirkpatrick
An Ugly Truth: Inside Facebook's Battle for
An Ugly Truth: Inside Facebook's Battle for DominationSheera Frenkel, Cecilia Kang
An Ugly Truth
An Ugly TruthSheera Frenkel, Cecilia Kang