{"title":"Superintelligence is coming. Should we let it? | Equity Podcast ","description":"AI companies have been talking about superintelligent AI like it's inevitable, but recent safety incidents like OpenAI's Hugging Face breach are demonstrating the potential dangers of deploying AI systems that are more capable than humans. So what happens when we can't reliably control what these systems do? \n\nOn this episode of TechCrunch's Equity podcast, Rebecca Bellan is joined by Connor Leahy, an AI researcher, entrepreneur, and now the U.S. Executive Director of nonprofit ControlAI, which is pushing for a far more radical approach to AI safety: stopping companies from developing superintelligence altogether. Leahy explains why he thinks the risks have become too great to manage through alignment and containment alone, and how what sounded far-fetched six months ago is now being backed by a wave of new legislation. \n\nSubscribe to Equity on YouTube, Apple Podcasts, Overcast, Spotify and all the casts. You also can follow Equity on X and Threads, at @EquityPod. \n\nChapters:\n00:00 Intro\n1:23 From GPT-2 shock to founding Control AI\n5:10 Why alignment isn't working...and can't be fixed with money\n9:48 Defining superintelligence: not a tool, an adversary\n11:15 Inside the Hugging Face incident\n14:34 Market failure and the case for regulation\n21:22 The point of no return and recursive self-improvement\n30:15 Money, power, and the international stakes\n35:17 Advice for investors, the odds, and a final note of hope\n41:08 Outro","kind":"Single Item","siteid":"MRgIYcoC","playlist":[{"title":"Superintelligence is coming. Should we let it? | Equity Podcast ","mediaid":"yszBqtzO","link":"https://cdn.jwplayer.com/previews/yszBqtzO","image":"https://cdn.jwplayer.com/v2/media/yszBqtzO/poster.jpg?width=720","images":[{"src":"https://cdn.jwplayer.com/v2/media/yszBqtzO/poster.jpg?width=320","width":320,"type":"image/jpeg"},{"src":"https://cdn.jwplayer.com/v2/media/yszBqtzO/poster.jpg?width=480","width":480,"type":"image/jpeg"},{"src":"https://cdn.jwplayer.com/v2/media/yszBqtzO/poster.jpg?width=640","width":640,"type":"image/jpeg"},{"src":"https://cdn.jwplayer.com/v2/media/yszBqtzO/poster.jpg?width=720","width":720,"type":"image/jpeg"},{"src":"https://cdn.jwplayer.com/v2/media/yszBqtzO/poster.jpg?width=1280","width":1280,"type":"image/jpeg"},{"src":"https://cdn.jwplayer.com/v2/media/yszBqtzO/poster.jpg?width=1920","width":1920,"type":"image/jpeg"}],"siteid":"MRgIYcoC","duration":2504,"content_source_type":"file","pubdate":1788968925,"updated":1788969938,"description":"AI companies have been talking about superintelligent AI like it's inevitable, but recent safety incidents like OpenAI's Hugging Face breach are demonstrating the potential dangers of deploying AI systems that are more capable than humans. So what happens when we can't reliably control what these systems do? \n\nOn this episode of TechCrunch's Equity podcast, Rebecca Bellan is joined by Connor Leahy, an AI researcher, entrepreneur, and now the U.S. Executive Director of nonprofit ControlAI, which is pushing for a far more radical approach to AI safety: stopping companies from developing superintelligence altogether. Leahy explains why he thinks the risks have become too great to manage through alignment and containment alone, and how what sounded far-fetched six months ago is now being backed by a wave of new legislation. \n\nSubscribe to Equity on YouTube, Apple Podcasts, Overcast, Spotify and all the casts. You also can follow Equity on X and Threads, at @EquityPod. \n\nChapters:\n00:00 Intro\n1:23 From GPT-2 shock to founding Control AI\n5:10 Why alignment isn't working...and can't be fixed with money\n9:48 Defining superintelligence: not a tool, an adversary\n11:15 Inside the Hugging Face incident\n14:34 Market failure and the case for regulation\n21:22 The point of no return and recursive self-improvement\n30:15 Money, power, and the international stakes\n35:17 Advice for investors, the odds, and a final note of hope\n41:08 Outro","tags":"Equity Podcast,AI Safety,AI regulation,AI policy,Connor Leahy,Control AI,existential risk,superintelligence","sources":[{"file":"https://cdn.jwplayer.com/manifests/yszBqtzO.m3u8","type":"application/vnd.apple.mpegurl"},{"file":"https://cdn.jwplayer.com/videos/yszBqtzO-A4a4avGx.m4a","type":"audio/mp4","label":"AAC Audio","bitrate":113435,"filesize":35505389},{"file":"https://cdn.jwplayer.com/videos/yszBqtzO-ILP3TxNb.mp4","type":"video/mp4","height":180,"width":320,"label":"180p","bitrate":235113,"filesize":73590464,"framerate":24.0},{"file":"https://cdn.jwplayer.com/videos/yszBqtzO-ObltmdYF.mp4","type":"video/mp4","height":270,"width":480,"label":"270p","bitrate":339147,"filesize":106153265,"framerate":24.0},{"file":"https://cdn.jwplayer.com/videos/yszBqtzO-AKHpU3QI.mp4","type":"video/mp4","height":360,"width":640,"label":"360p","bitrate":436771,"filesize":136709353,"framerate":24.0},{"file":"https://cdn.jwplayer.com/videos/yszBqtzO-N26QHIgL.mp4","type":"video/mp4","height":406,"width":720,"label":"406p","bitrate":504766,"filesize":157991994,"framerate":24.0},{"file":"https://cdn.jwplayer.com/videos/yszBqtzO-Cm3xYLF4.mp4","type":"video/mp4","height":540,"width":960,"label":"540p","bitrate":758424,"filesize":237386754,"framerate":24.0},{"file":"https://cdn.jwplayer.com/videos/yszBqtzO-lF2gWf1A.mp4","type":"video/mp4","height":720,"width":1280,"label":"720p","bitrate":1063133,"filesize":332760929,"framerate":24.0},{"file":"https://cdn.jwplayer.com/videos/yszBqtzO-VdyLbzBg.mp4","type":"video/mp4","height":1080,"width":1920,"label":"1080p","bitrate":2114448,"filesize":661822420,"framerate":24.0}],"tracks":[{"file":"https://cdn.jwplayer.com/strips/yszBqtzO-120.vtt","kind":"thumbnails"}],"jwpseg":["52080096","52080095","52080094","52080093","52080092","52080087","52080049","52080001","52060032","52060018","52060001","52040029","52040019","52040001","52030001","52010597","52010596","52010464","52010388","52010386","52010115","52010090","52010077","52010072","52010053","52010052","20040089","20040088","20040087","20040013","20040011","20040001","2003O3EQZQ","20035S2VRK","20031028","20031022","20031010","20010635","20010632","20010597","20010596","20010061","20010058","20010053","20010052","18050003","18040008","18040004","18040002","18030125","18030085","18030007","18010635","18010632","18010597","18010596","18010061","18010058","18010053","18010052","17ff896286360a6eb120eca4c29c528b0e","16010001","16000001","13011001"],"variations":{}}],"feed_instance_id":"9cced993-81f2-4831-8879-fa230d88f583"}