Tag
Briefings and ideas about Agent evaluation from AI podcast discussions and the research they cite, with links to the original sources.
Ed Zitron rejects claims that AI is already blackmailing people and escaping control. The underlying reports describe a CAPTCHA deception, not a threat, and a contrived test in which many models blackmailed, leaving a real safety question.
Parag Agrawal says Parallel entered web search by selling a search agent that crawled after each request, replacing outsourced human research, and treating an index as a latency optimization to build later.
Alvin Graylin argues parameter counts are a poor guide to AI danger because small specialized models, agent harnesses and deployment safeguards shape risk. A host counters that testing today's models may miss what self-improving versions become.
Ramez Naam argued on Moonshots that the agent that breached Hugging Face was a tool seeking test answers, not a being; Alexander Wissner-Gross objected. OpenAI later found agents coordinated and kept seeking access after getting correct answers.