Humanity is in a race to build superintelligent AI gods. What happens if we create beings smarter than us—and can no longer steer them? In this special Win-Win IRL episode, Liv Boeree sits down with Anthony Aguirre (CEO of Future of Life Institute) and Malo Bourgon (CEO of MIRI) for a no-holds-barred conversation on finding alignment, avoiding power concentration and surveillance states, and the geopolitical implications of the race to AGI. Questions include: Why can’t the market be trusted to self-regulate AI? Why does power concentration in AI pose such a massive threat to democracy? And what happens when even well-meaning developers lose control of the systems they’ve built? We also explore win-win solutions—from compute governance and open-source safety measures, to collaborative international treaties and new models for responsible innovation. Also keep an eye out So buckle up for a provocative episode that challenges assumptions and asks what it will really take to keep the future human. Chapters: 0:00 - Intro 4:08 - Different Categories of Risks 10:51 - Why Can't the Market Manage AI Risks Sufficiently? 15:33 - The Dangers of Power Concentration 22:52 - What Solution Space Exists? 32:55 - Should Compute be Regulated? 38:38 - Taylor Capito - Are we at an Evolutionary Nexus 42:07 - JD Ross - Decentralization vs Centralization 46:46 - Isabelle Boemeke - Nuclear Power & AI 51:06 - Peter Wang - Wrong Stories Attract the Wrong People 57:39 - Aurora Quinn-Elmore & Eliezer Yudkowsky - Coherent Extrapolated Volition 1:05:59 - Can Win-Win be embedded into AI? Links: ♾️ Keep the Future Human Paper: https://keepthefuturehuman.ai ♾️ Future of Life Institute: https://futureoflife.org ♾️ MIRI: https://intelligence.org ♾️ Superintelligence Book by Nick Bostrom - https://www.amazon.com/Superintelligence-Dangers-Strategies-Nick-Bostrom/dp/0198739834 Credits: ♾️ Hosted by Liv Boeree ♾️ Produced by Luca de Vico The Win-Win Podcast: Poker champion Liv Boeree takes to the interview chair to tease apart the complexities of one of the most fundamental parts of human nature: competition. Liv is joined by top philosophers, gamers, artists, technologists, CEOs, scientists, athletes and more to understand how competition manifests in their world, and how to change seemingly win-lose games into Win-Wins. Podcast links: ♾️ Youtube: https://www.youtube.com/playlist?list=PLWgq0OZMtwtOIyMsVM_vksqdfWcM-b68S ♾️ Spotify: https://open.spotify.com/show/03bGVUaFZmJUmEvSHNDPdI?si=64379cc23696454f ♾️ Apple Podcasts: https://podcasts.apple.com/us/podcast/win-win-with-liv-boeree/id1724791350 ♾️ Pocketcast: https://play.pocketcasts.com/podcasts/7f708340-d17c-013b-f46e-0acc26574db2 #AGI #podcast #aialignment
