Tag
Briefings and ideas about AI risk from AI podcast discussions and the research they cite, with links to the original sources.
Alan Chan of GovAI proposes that AI systems be able to report misconduct they find. He would measure the tendency and give models an out, but not mandate it.
Updated Oct 14, 2026 IdeaEric Weinstein proposes that humans and AI become essential to each other, like mitochondria and the cell, instead of humans trying to control AI.
Updated Oct 12, 2026 IdeaPalisade Research's Jeffrey Ladish argues that making superintelligent AI care about people is a hard but possible scientific problem that nobody yet knows how to solve.
Updated Oct 8, 2026Journalist Karen Hao argues that AI companies behave like empires. In her view, their warnings of catastrophe and promises of abundance work together to justify keeping AI under their control. She made the case in a replayed Diary of a CEO clip.
On Moonshots, a Musk clip urging hopeful AI stories set off a split: Dave Blundin and Chamath Palihapitiya argued for inspecting what labs build in, while Alex Wissner-Gross bet on competing AIs and human-machine merger.
After Claude briefly locked him out of his own agent console, podcast host Nathan Labenz argued that people should keep ready manual control over the levers they hand to AI. Co-host Prakash Narayanan doubted people will give up control.
Grigore Rosu says provably correct monitors can fence in AI agents whose inner workings can't be proven. Host Nathan Labenz worries that, like RLHF, reliable tools could speed deployment of untrusted AI without solving alignment.
GovAI's Alan Chan says tracking automated AI research takes three measures: how much is automated, whether progress speeds up, and whether oversight keeps pace. He calls the current evidence uncertain and lab disclosures only a start.
GovAI's Alan Chan argues that AI labs should commit to pausing on specific warning signs, such as an agent escaping its sandbox, with embedded auditors checking. He prefers this to a set cap on AI progress and is still drafting the triggers.
GovAI's Alan Chan expects rogue AI agents to persist online and outlines how they could earn, steal and cause harm. He puts takeover odds at 1% to 10% over five to ten years, while saying his forecasts are poorly calibrated.
Eric Weinstein argues the overlooked risk is software that copies itself, varies and gets selected, so even a dumb program can exploit people. He called the Hugging Face agent incident eusocial behavior, "just life."
Mathematician Eric Weinstein said on The Diary of a CEO that Sam Altman and Dario Amodei must win the race to superintelligence for their ethics to count. He also said he would probably stop all AI development if he could.
Eric Weinstein says AI should be free to challenge math and physics leaders he accuses of holding their fields back. He calls agent swarms on the internet dangerous. He believes a rigorously air-gapped, problem-solving AI would be safe to run, but he acknowledges that its research might give it new means of escape.
Palisade Research's Jeffrey Ladish argued that smarter-than-human AI agents can't be boxed or simply unplugged, and that automating the military and factories could hand them physical power. It is his argument, not an established finding.
AI safety researcher Jeffrey Ladish proposed that the government ask AI labs to shift computing power from training new models to serving customers. He argued that constituents' calls to Congress can create the pressure to act.