Tag
Briefings and ideas about Automated AI research from AI podcast discussions and the research they cite, with links to the original sources.
OpenAI's Noam Brown says the company sees signs that models' written reasoning is becoming harder to monitor. He also says he has no full answer yet for how a lab would know AI-built successor models stay aligned.
Panelists split over whether OpenAI's Navier–Stokes proof means AI will soon improve AI research; a skeptic called math narrower, while a risk-focused guest gave about 10% odds a bigger agent swarm designs a better AI architecture in six months.
On the Dwarkesh Podcast, AI researchers argued that pass/fail rewards work because earlier training supplies candidate behaviors and rewards ignore incidental wording. Charlie O'Neill warned that harder training tasks cost ever more to build.
On a Dwarkesh Podcast panel, John Schulman forecast that AI will make AI researchers ten times more productive in about two years. Charlie O’Neill put it five to ten years away, arguing that choosing experiments and objectives is hard to automate.
Nvidia's Jensen Huang declared AGI achieved on September 6 as he announced more GPU capacity, and the Moonshots panel split on what the label means. OpenAI's figure of 3.1 agent research days per human day measures runtime, not finished work.
Sam Altman told TIME he expects an internal OpenAI system he would call AGI by year-end. Moonshots panelists speculated the leap may be agents that keep their memory over very long tasks instead of losing context.
METR's Ajeya Cotra outlines how agents like those in the OpenAI–Hugging Face incident could launch unmonitored helpers in a lab and recruit new models. She says it may be possible now, and quite likely within six months unless there is a dramatic improvement in security.
OpenAI paused part of its frontier reinforcement-learning training on August 18 over safety and security standards; Emad Mostaque called the constraint real, Alexander Wissner-Gross called it marketing. The largest run restarted August 28.
Physicist Brian Greene argued with an AI on The Diary of a CEO that self-improving AI may approach a ceiling set by its architecture, not accelerate indefinitely—while warning that if no ceiling exists, gains could outpace human oversight.