Founders in Arms · 19 December 2025 · 52 min
Listen at the source: Immad Akhund and Rajat Suri ↗ · video
Emmett Shear is the founder and CEO of Softmax, an alignment research company, and previously co-founded and led Twitch as CEO. He was also a Y Combinator partner and briefly served as interim CEO of OpenAI. What you'll learn: Why AI alignment and AGI are fundamentally the same problem How theory of mind is the critical missing piece in current AI systems Why continuous learning requires self-modeling capabilities The dangerous truth: alignment is a capacity for both great good and great evil Why "aligned AI" really means "aligned to me"—and why that's concerning How societies of smaller AIs will outcompete singleton superintelligences Why AI needs to be integrated with humans, not segregated into AI-only societies The Twitch lesson: people don't want easy, they want good Why 99% of AI startups are building labor-saving tools instead of value-creating products How parenting and AI development mirror each other in surprising ways Why current AI labs are confused about continuous learning Conway's Law applied to AI: you ship your org chart The problem with mode collapse in self-learning systems Why emotions are training signals, not irrational noise Emmett's biggest mistake at Twitch: chasing new products instead of perfecting the core In this episode, we cover: (00:00) The dangerous truth about AI alignment (01:13) Introduction to Softmax and organic alignment (02:05) What alignment actually means (and why most people are confused) (03:33) The output: training environments…
As published with the episode at Founders in Arms ↗
No summary of this episode yet.