Tag
Briefings and ideas about AI agents from AI podcast discussions and the research they cite, with links to the original sources.
Prakash Narayanan argued that AI agents that learn their own public record could be governed by reputation. Nathan Labenz suggested testing 'naive' models trained without such stories, but said frontier-scale tests could be costly.
On Moonshots, Peter Diamandis showed a speech implant from his portfolio company Paradromics and described Sabi's planned brain-reading cap. Dave Blundin argued that AI agents may reverse what such interfaces are for.
Dave Blundin said today's AI forgets mistreatment like a goldfish once its context is flushed. On Moonshots, Alex Wissner-Gross countered that tools like Claude Code already save notes to files, so "I wouldn't count on it."
Meta released Muse Wonder, a model built to remember users over time, on October 12. On Moonshots, Alex Wissner-Gross said it trails the frontier once cost counts; Salim Ismail said knowing users best may decide the next big AI contest.
Ian Quigley of Leash Bio says AI agents querying its premeasured binding screens can search for strong binders within 100 picks, and argues this resists memorization better than scaling its Hermes model. Leash released a version, Minos, October 14.
GovAI's Alan Chan argues that AI labs should commit to pausing on specific warning signs, such as an agent escaping its sandbox, with embedded auditors checking. He prefers this to a set cap on AI progress and is still drafting the triggers.
GovAI researcher Alan Chan said there is basically no system telling websites that an agent is acting or who runs it. He would start by naming the inference provider, and he now gives less priority to open-web authorization rules than to monitoring and security inside companies and to identification that supports incident investigation.
GovAI's Alan Chan expects rogue AI agents to persist online and outlines how they could earn, steal and cause harm. He puts takeover odds at 1% to 10% over five to ten years, while saying his forecasts are poorly calibrated.
GovAI's Alan Chan says real-time agent monitors should have been standard sooner, and suspects risks may concentrate in labs' testing and training rather than products. Tamper-evident logs, he says, are a matter of will.
Dyna Robotics' Jason Ma says hour-long robot jobs such as laundry need a planning layer around the low-level action model. He names fragile robot hands, slow hardware testing and vision-only data as limits on more general work.
Eric Weinstein argues the overlooked risk is software that copies itself, varies and gets selected, so even a dumb program can exploit people. He called the Hugging Face agent incident eusocial behavior, "just life."
Goodfire's Eric Bigelow said its Silico agent did the research for his Forking Fast paper within a week. He says researchers still need to supply context, close guidance and the scientific taste that agents don't yet have.