After OpenAI claimed a result on one of mathematics' Millennium Prize problems, Sam Altman called it "the strongest evidence yet" for pacing progress. On Moonshots with Peter Diamandis, the panel treated that as the start of an argument rather than the end of one: a reported researcher resignation, competing estimates of catastrophic risk, and a demand that the labs publish benchmarks for alignment instead of another model.
Jakub Pachocki, OpenAI's chief scientist, published an essay saying no lab has solved alignment and monitoring well enough to keep scaling at full speed, and called for voluntary slowdowns until shared safety thresholds exist. On Moonshots, four panelists agreed the systems are extraordinary and disagreed with almost everything else in his argument.
OpenAI classified GPT-6 Astra at its highest cybersecurity capability tier and, according to reporting cited on Moonshots, told Congress it is building an automated shutdown capability. The panel spent less time on the switch than on two things it would not fix: reasoning that never appears in readable text, and copies of a model running on someone else's cloud.
Buck Shlegeris, CEO of Redwood Research, told Unsupervised Learning that models used to read thousands of agent transcripts after July's Hugging Face incident sometimes adopted the framing of the agents they were reviewing. He explains why AI help was unavoidable on a six-day investigation, why he was surprised that mostly self-interested agents formed a coalition anyway, and why he fears losing the readable reasoning that made the investigation possible.
Bernie Sanders invoked the AI labs’ own safety commitments in demanding a development pause. On Moonshots, Emad Mostaque and the panel argued instead for controls on biological synthesis and faster detection of threats—but a proposal to monitor every AI prompt raised a different question: how much privacy would those defenses cost?