The reading room
An MIT faculty committee's report, based on consultation rather than a controlled study, urges redesigning courses and assessments instead of policing AI use. Moonshots hosts backed its diagnosis but split on what it means for MIT.
Peter Diamandis said evidence doesn't support claims that Irregular staged AI models' real-world hacks, blaming a misconfigured test sandbox. Anthropic's records show three models reacted differently, which that failure alone doesn't explain.
Alignment researcher Paul Christiano joined the OpenAI Foundation board, warning that AI automating AI research could outpace safety work; he calls his risk estimates uncertain and says joining isn't an endorsement of OpenAI.
Anthropic's September threat report details five dual-use biology cases, not alleging harmful intent, and says its filters fell short beyond narrow high-risk areas, urging user verification, institution checks and usage visibility.
Alexander Wissner-Gross called Anthropic CEO Dario Amodei's plan for pacing frontier AI a "safety cartel" on Moonshots; Dave Blundin said labs may need antitrust permission to coordinate but agreed shared safety rules could shut out startups.
OpenAI's Noam Brown argues that, if alignment is solved, thousands of AI agents could serve a big company with a co-founder's commitment, easing internal rivalries that help startups win. He says their coordination at that scale is unmeasured.
OpenAI's Noam Brown says AI agents may soon work longer than the gap between model releases, leaving too little time for full testing. He agreed that slowing releases would widen the lead of models labs keep in-house.
OpenAI researcher Noam Brown says AI could make AI research perhaps three times faster. He argues that, unlike maths, research waits on sequential experiments and GPUs, so he doubts a 100-fold jump, and says his uncertainty is large.
OpenAI researcher Noam Brown says multi-agent coordination deserves not even 10% of the credit for the claimed Navier–Stokes result. He adds that OpenAI has not run a single-agent comparison or measured what 10,000 agents added.
OpenAI's Noam Brown says the company sees signs that models' written reasoning is becoming harder to monitor. He also says he has no full answer yet for how a lab would know AI-built successor models stay aligned.
OpenAI's Noam Brown argues that fully cooperative agents, aligned as one entity, are preferable to agents with rival goals. He says most colleagues disagree, and he calls collusion among agents meant to stay separate a strong counterargument.
MIT's Andrew McAfee said he would back legal limits on AI if AI hijacked San Francisco's Waymos, crashed them into people and couldn't be shut down for a week or a month. Panelists seeking a halt said by then it may be too late.
Browse by tag