Tag
Briefings and ideas about Reasoning models from AI podcast discussions and the research they cite, with links to the original sources.
Computer scientist Alex Wissner-Gross argued that AI solving math at scale, not quantum computing, is the real threat to encryption, though he named no broken system. Salim Ismail countered that AI can also build stronger cryptography.
Ian Quigley of Leash Bio says AI agents querying its premeasured binding screens can search for strong binders within 100 picks, and argues this resists memorization better than scaling its Hermes model. Leash released a version, Minos, October 14.
Goodfire researcher Eric Bigelow resampled a GPT-3.5 model's reasoning at every token and saw answers collapse at single tokens, some arbitrary. He argues the "decision" happens in sampling; newer reasoning models often fork more smoothly.
Goodfire researcher Eric Bigelow said training that rewards only final answers gives models no reason to keep their reasoning readable. He said his optimism about monitoring that reasoning has faded sharply over about a year.
TypeSafe says its Jev model returns typed choices or scores in 70–500 milliseconds in its own tests. On Moonshots, panelists said such models could handle many small organizational decisions and noted open-source versions exist.
Keerthana Gopalakrishnan, who leads Gemini Robotics research at Google DeepMind, explained how a reasoning model open to developers directs an action model limited to testers, and where she says failures arise.
Daniel McKinnon, whose son died of a rare lung disease, built an AI pipeline that rediscovered a deletion a lab had missed and a specialist later found. His four-month-old Gamow Labs now uses AI agents to reanalyse unresolved genomes.
OpenAI researcher Noam Brown says AI could make AI research perhaps three times faster. He argues that, unlike maths, research waits on sequential experiments and GPUs, so he doubts a 100-fold jump, and says his uncertainty is large.
OpenAI researcher Noam Brown says multi-agent coordination deserves not even 10% of the credit for the claimed Navier–Stokes result. He adds that OpenAI has not run a single-agent comparison or measured what 10,000 agents added.
OpenAI's Noam Brown says the company sees signs that models' written reasoning is becoming harder to monitor. He also says he has no full answer yet for how a lab would know AI-built successor models stay aligned.
Alexander Wissner-Gross argued next-word prediction as a training task may last indefinitely, while the transformer architecture is already being replaced piece by piece. Another panelist guessed chips move to photonics in 18 months to two years.
On the Dwarkesh Podcast, AI researchers argued that pass/fail rewards work because earlier training supplies candidate behaviors and rewards ignore incidental wording. Charlie O'Neill warned that harder training tasks cost ever more to build.