Tag
Briefings and ideas about Superintelligence from AI podcast discussions and the research they cite, with links to the original sources.
Asked how likely AI is to produce a much better world, Alexander Wissner-Gross said above 90% over more than ten years; Dave Blundin said 99.9% if humanity gets past near-term misuse of AI, and Salim Ismail near 100% if institutions are rebuilt.
Alexander Wissner-Gross called falling PISA scores a moral panic because AI is improving faster than human skills decline. Dave Blundin called the reading drop "fundamentally horrible." Unusually sharp 2018–2022 drops predated ChatGPT.
Alignment researcher Paul Christiano joined the OpenAI Foundation board, warning that AI automating AI research could outpace safety work; he calls his risk estimates uncertain and says joining isn't an endorsement of OpenAI.
MIT's Andrew McAfee said he would back legal limits on AI if AI hijacked San Francisco's Waymos, crashed them into people and couldn't be shut down for a week or a month. Panelists seeking a halt said by then it may be too late.
MIT's Andrew McAfee said he was "dead flat wrong" about AI squeezing white-collar jobs and expects worker shortages in a decade. A study he cites finds 22- to 25-year-olds' employment in the most AI-exposed jobs fell, mainly through weaker hiring.
A pause advocate argued in a Diary of a CEO debate that chip tracking could verify a global ban on training superintelligence. Others asked how banned runs could be told from permitted work; advocates admitted cheaper training would weaken it.
Panelists split over whether OpenAI's Navier–Stokes proof means AI will soon improve AI research; a skeptic called math narrower, while a risk-focused guest gave about 10% odds a bigger agent swarm designs a better AI architecture in six months.
On a Dwarkesh Podcast panel, John Schulman forecast that AI will make AI researchers ten times more productive in about two years. Charlie O’Neill put it five to ten years away, arguing that choosing experiments and objectives is hard to automate.
Sam Altman called OpenAI's claimed Navier–Stokes result the strongest evidence yet for pacing AI; on Moonshots, Peter Diamandis urged labs to publish measurable alignment plans, while other panelists disputed that remedy.
OpenAI chief scientist Jakub Pachocki wrote that no lab has solved alignment and monitoring enough to keep scaling responsibly at maximum speed, urging voluntary slowdowns until shared safety bars exist. Moonshots panelists mostly disputed him.
Sanders and Casar plan a bill to permanently ban superintelligent AI and temporarily pause advanced development, a day after the G20 backed non-binding, pro-innovation Carolina Principles. Salim Ismail faulted its human-level trigger.
Sam Altman told TIME he expects an internal OpenAI system he would call AGI by year-end. Moonshots panelists speculated the leap may be agents that keep their memory over very long tasks instead of losing context.