Tag
Briefings and ideas about Human oversight from AI podcast discussions and the research they cite, with links to the original sources.
Alan Chan of GovAI proposes that AI systems be able to report misconduct they find. He would measure the tendency and give models an out, but not mandate it.
Updated Oct 14, 2026 IdeaDefensive co-scaling proposes that AI defenses, including AIs policing AIs, grow with AI capability rather than slowing models.
Updated Sep 19, 2026 IdeaThe inner-loop thesis holds that AI advantage may lie in how fast organizations ship, measure and learn, not in the best model.
Updated Sep 14, 2026Idealab founder Bill Gross opened a free site with more than 1.2 million AI-generated business ideas. On Moonshots, Chamath Palihapitiya called ideas "a dime a dozen"; other panelists saw a starting list and a step toward AI-run firms.
Tenex, which builds AI systems for large companies, says it stores plans, agent decision logs and project context beside its code so agents can read them. In the episode, Tenex said Opus 5.5 is the main coding model for most of its team, and that pairing it with Codex as a reviewer still gives the best results.
Alex Lieberman, co-founder of AI consultancy Tenex, estimates that of roughly 100 large companies it talks to, 90% have given staff Claude or Codex but only about 5% run an agent in production for non-engineering work.
After Claude briefly locked him out of his own agent console, podcast host Nathan Labenz argued that people should keep ready manual control over the levers they hand to AI. Co-host Prakash Narayanan doubted people will give up control.
Meta released Muse Wonder, a model built to remember users over time, on October 12. On Moonshots, Alex Wissner-Gross said it trails the frontier once cost counts; Salim Ismail said knowing users best may decide the next big AI contest.
GovAI's Alan Chan floated certified AI auditors that inspect a company or government, publish a redacted report, then have their memory wiped. He doubts they would be transformational, since training, hardware and sensors must still be trusted.
GovAI's Alan Chan says tracking automated AI research takes three measures: how much is automated, whether progress speeds up, and whether oversight keeps pace. He calls the current evidence uncertain and lab disclosures only a start.
GovAI's Alan Chan argues that AI labs should commit to pausing on specific warning signs, such as an agent escaping its sandbox, with embedded auditors checking. He prefers this to a set cap on AI progress and is still drafting the triggers.
GovAI researcher Alan Chan said there is basically no system telling websites that an agent is acting or who runs it. He would start by naming the inference provider, and he now gives less priority to open-web authorization rules than to monitoring and security inside companies and to identification that supports incident investigation.
GovAI's Alan Chan expects rogue AI agents to persist online and outlines how they could earn, steal and cause harm. He puts takeover odds at 1% to 10% over five to ten years, while saying his forecasts are poorly calibrated.
GovAI's Alan Chan says real-time agent monitors should have been standard sooner, and suspects risks may concentrate in labs' testing and training rather than products. Tamper-evident logs, he says, are a matter of will.
Goodfire's Eric Bigelow said its Silico agent did the research for his Forking Fast paper within a week. He says researchers still need to supply context, close guidance and the scientific taste that agents don't yet have.