Source podcast
Nathan Labenz explores AI through expert interviews and discussions of its uses and consequences.
Nathan Labenz says helping people use today's AI could deliver the growth markets want without more scaling. He bases the opinion on one encounter with an elderly neighbor, and a market forecast in the conversation prompted it.
Phil Maher, founder of the 8mm home-movie archive Stockfilm, says AI companies want its original, uncleaned footage. He argues that film provably made by humans could gain rarity value if AI video becomes abundant and nearly free. He said AI agents have hardly used the purchasing routes he built for them.
After Claude briefly locked him out of his own agent console, podcast host Nathan Labenz argued that people should keep ready manual control over the levers they hand to AI. Co-host Prakash Narayanan doubted people will give up control.
Nathan Labenz had Claude test Gemini 4 against his current models and found it competitive but slightly behind. He says security and predictability now matter more to him than small quality gains for agents with broad access.
Grigore Rosu says provably correct monitors can fence in AI agents whose inner workings can't be proven. Host Nathan Labenz worries that, like RLHF, reliable tools could speed deployment of untrusted AI without solving alignment.
Researcher Cameron Berg argues that, since no one knows whether language models feel anything, capping their most distressing internal signals is a cheap hedge if tests show behavior stays the same. He puts the odds near a coin flip.
Prakash Narayanan argued that AI agents that learn their own public record could be governed by reputation. Nathan Labenz suggested testing 'naive' models trained without such stories, but said frontier-scale tests could be costly.
Runtime Verification's leaders say an LLM's Rust port of kernel code, checked by differential fuzzing and Lean proofs, surfaced Linux bugs. The company's write-ups show partial proofs that are only as good as their specifications.
In a preprint, Cameron Berg and Casper Kaiser report that steering a hidden good-or-bad signal in language models shifted their later choices between arbitrary zones while recall mostly held. The effect was robust in five of seven models tested.
GovAI's Alan Chan floated certified AI auditors that inspect a company or government, publish a redacted report, then have their memory wiped. He doubts they would be transformational, since training, hardware and sensors must still be trusted.
GovAI's Alan Chan says tracking automated AI research takes three measures: how much is automated, whether progress speeds up, and whether oversight keeps pace. He calls the current evidence uncertain and lab disclosures only a start.
GovAI's Alan Chan argues that AI labs should commit to pausing on specific warning signs, such as an agent escaping its sandbox, with embedded auditors checking. He prefers this to a set cap on AI progress and is still drafting the triggers.
