Tag
Briefings and ideas about AI risk from AI podcast discussions and the research they cite, with links to the original sources.
Asked how likely AI is to produce a much better world, Alexander Wissner-Gross said above 90% over more than ten years; Dave Blundin said 99.9% if humanity gets past near-term misuse of AI, and Salim Ismail near 100% if institutions are rebuilt.
Robinhood CEO Vlad Tenev argued that ordinary liability may suffice for small AI failures but not catastrophic ones, and that regulation need not mean capture. Alexander Wissner-Gross countered that AI safety evaluators overplay risk.
Alignment researcher Paul Christiano joined the OpenAI Foundation board, warning that AI automating AI research could outpace safety work; he calls his risk estimates uncertain and says joining isn't an endorsement of OpenAI.
Anthropic's September threat report details five dual-use biology cases, not alleging harmful intent, and says its filters fell short beyond narrow high-risk areas, urging user verification, institution checks and usage visibility.
Alexander Wissner-Gross called Anthropic CEO Dario Amodei's plan for pacing frontier AI a "safety cartel" on Moonshots; Dave Blundin said labs may need antitrust permission to coordinate but agreed shared safety rules could shut out startups.
OpenAI's Noam Brown says AI agents may soon work longer than the gap between model releases, leaving too little time for full testing. He agreed that slowing releases would widen the lead of models labs keep in-house.
MIT's Andrew McAfee said he would back legal limits on AI if AI hijacked San Francisco's Waymos, crashed them into people and couldn't be shut down for a week or a month. Panelists seeking a halt said by then it may be too late.
A pause advocate argued in a Diary of a CEO debate that chip tracking could verify a global ban on training superintelligence. Others asked how banned runs could be told from permitted work; advocates admitted cheaper training would weaken it.
Panelists split over whether OpenAI's Navier–Stokes proof means AI will soon improve AI research; a skeptic called math narrower, while a risk-focused guest gave about 10% odds a bigger agent swarm designs a better AI architecture in six months.
Professor Jiang says his main worry about AI is not surveillance but that it cheapens the human experience and distracts people from spiritual growth, though he allows AI may outdo humans at mathematics and medical diagnosis.
Sam Altman called OpenAI's claimed Navier–Stokes result the strongest evidence yet for pacing AI; on Moonshots, Peter Diamandis urged labs to publish measurable alignment plans, while other panelists disputed that remedy.
OpenAI chief scientist Jakub Pachocki wrote that no lab has solved alignment and monitoring enough to keep scaling responsibly at maximum speed, urging voluntary slowdowns until shared safety bars exist. Moonshots panelists mostly disputed him.