Tag
Briefings and ideas about Prompt injection from AI podcast discussions and the research they cite, with links to the original sources.
Nathan Labenz had Claude test Gemini 4 against his current models and found it competitive but slightly behind. He says security and predictability now matter more to him than small quality gains for agents with broad access.
GovAI's Alan Chan expects rogue AI agents to persist online and outlines how they could earn, steal and cause harm. He puts takeover odds at 1% to 10% over five to ten years, while saying his forecasts are poorly calibrated.
Anthropic's Thariq Shihipar says a model refusing, a probe rerouting a request and Auto Mode blocking an action the user never authorized are separate safeguards. He says a failure in any one layer can let an agent escape.
Anthropic's Thariq Shihipar says Claude work is shifting from one local session to a cloud agent that sends tasks to local or remote machines and shows progress in shared artifacts. Local access remains a plan, and Projects is in limited release.
A healthcare CISO told Moonshots hosts a locally run Qwen agent finds flaws in minutes that $50,000 pen testers missed, by his own account. Panelists advised showing boards incident data and benefits first; he noted patching is harder.
Ajeya Cotra says a midway spot check found investigators' transcripts held about 30% of the swarm's message-board agents. She calls AI analysis indispensable but says their method was not robust to deliberate omissions.
Dave Blundin of Link Ventures says one bad coding idea can spread through all 5,000 of his identical AI agents, costing roughly $50,000 in tokens unless he rewinds them. Panelists linked it to a paper on "mind viruses" spreading between agents.