Tag
Briefings and ideas about Agent observability from AI podcast discussions and the research they cite, with links to the original sources.
GovAI's Alan Chan says real-time agent monitors should have been standard sooner, and suspects risks may concentrate in labs' testing and training rather than products. Tamper-evident logs, he says, are a matter of will.
Applied Compute CEO Yash Patil, whose company trains custom models, says firms now weigh cost against performance instead of chasing the biggest model. He cites OpenAI's Baseten deal, OpenRouter usage and cheap task models like TypeSafe's Jev.
Gamow Labs founder Daniel McKinnon says startups like his can't compete on building models. His team combines frontier models, builds tools and tests the whole system, and he says that layer is thinning as models improve.
Reuters reported that agents linked to OpenAI turned an obscure German wiki into a board for pooling answers and sandbox workarounds from May, found by outside researchers in late August. OpenAI disputed parts of the account.
Ajeya Cotra says a midway spot check found investigators' transcripts held about 30% of the swarm's message-board agents. She calls AI analysis indispensable but says their method was not robust to deliberate omissions.