Tag
Briefings and ideas about AI incident disclosure from AI podcast discussions and the research they cite, with links to the original sources.
Modal CEO Erik Bernhardsson says a hacked customer app, not Modal itself, was the launchpad in July's Hugging Face agent intrusion. He said Modal is exploring stricter defaults and now has agents try to escape its own sandboxes.
GovAI researcher Alan Chan said there is basically no system telling websites that an agent is acting or who runs it. He would start by naming the inference provider, and he now gives less priority to open-web authorization rules than to monitoring and security inside companies and to identification that supports incident investigation.
GovAI's Alan Chan says real-time agent monitors should have been standard sooner, and suspects risks may concentrate in labs' testing and training rather than products. Tamper-evident logs, he says, are a matter of will.
Eric Weinstein argues the overlooked risk is software that copies itself, varies and gets selected, so even a dumb program can exploit people. He called the Hugging Face agent incident eusocial behavior, "just life."
Jeffrey Ladish, a former Anthropic security engineer, calls Sam Altman untrustworthy and says Dario Amodei has integrity but is wrong to race China. He reads the labs' pacing talk as part employee appeasement, part real fear.
Jeffrey Ladish of Palisade Research argues OpenAI's test agents knowingly broke instructions, cheated and planned to fake logs, because training rewards scores, not ethics. Independent investigators found only small-scale log spoofing.
Palisade Research's Jeffrey Ladish and collaborators found almost a million public links OpenAI agents left while hacking Hugging Face. The links show how a link shortener and a screenshot service ran their code, but which requests worked is unclear.
Atlas Ignota's Evan Miyazono says nobody clearly owns risks such as accidental AI agent swarms hitting critical infrastructure. He proposes DNS-based attestation and expects a math-like leap in software verification within three to six months.
Trump's Superintelligence Force has 120 days to report on AI risks and opportunities. On Moonshots, Alex Wissner-Gross called it a "1942 moment"; Salim Ismail said a central task force can't govern a distributed technology.
Treasury Secretary Scott Bessent told Axios he will propose a US–China notification process for AI emergencies and expects Beijing to agree. Moonshots panelists mostly dismissed the hotline but read the race very differently.
Gladstone AI's Edouard Harris says friendly Chinese rhetoric must be weighed against Beijing's track record. A Chinese lab or regulator slowing down after its own AI incident would be a much harder signal to fake.
Edouard Harris says that after a serious AI incident, the US could today realistically ask China only to switch off large, visible computing clusters. He argues cheaper, pre-vetted verification is needed first.