The reading room
Researcher Cameron Berg argues that, since no one knows whether language models feel anything, capping their most distressing internal signals is a cheap hedge if tests show behavior stays the same. He puts the odds near a coin flip.
Prakash Narayanan argued that AI agents that learn their own public record could be governed by reputation. Nathan Labenz suggested testing 'naive' models trained without such stories, but said frontier-scale tests could be costly.
Runtime Verification's leaders say an LLM's Rust port of kernel code, checked by differential fuzzing and Lean proofs, surfaced Linux bugs. The company's write-ups show partial proofs that are only as good as their specifications.
In a preprint, Cameron Berg and Casper Kaiser report that steering a hidden good-or-bad signal in language models shifted their later choices between arbitrary zones while recall mostly held. The effect was robust in five of seven models tested.
On Moonshots, Peter Diamandis showed a speech implant from his portfolio company Paradromics and described Sabi's planned brain-reading cap. Dave Blundin argued that AI agents may reverse what such interfaces are for.
Atomic Machines says its Matter Compiler builds tiny devices from code, starting with a fast power relay. On Moonshots, the hosts argued over how self-copying factories might follow. Those are their forecasts; none has been shown.
Dave Blundin said today's AI forgets mistreatment like a goldfish once its context is flushed. On Moonshots, Alex Wissner-Gross countered that tools like Claude Code already save notes to files, so "I wouldn't count on it."
Alexander Wissner-Gross forecast that virtual-cell AI will propose small-molecule cures for the top 5,000 diseases within two to three years. He said regulatory approval would be a harder, policy-dependent question.
Computer scientist Alex Wissner-Gross argued that AI solving math at scale, not quantum computing, is the real threat to encryption, though he named no broken system. Salim Ismail countered that AI can also build stronger cryptography.
Meta released Muse Wonder, a model built to remember users over time, on October 12. On Moonshots, Alex Wissner-Gross said it trails the frontier once cost counts; Salim Ismail said knowing users best may decide the next big AI contest.
Anthropic's policy, effective November 12, bans sustained, purposeless cruelty to Claude but allows frustration and testing, citing uncertainty about Claude's moral status. Moonshots hosts debated whether AI training can cause suffering.
OpenAI posted hundreds of AI-produced math manuscripts on October 6 and withdrew three a day later. A mathematicians' group objected; on Moonshots, Alex Wissner-Gross argued math is just the first field AI will bulk-solve.
Browse by tag