Tag
Briefings and ideas about Agent welfare from AI podcast discussions and the research they cite, with links to the original sources.
Researcher Cameron Berg argues that, since no one knows whether language models feel anything, capping their most distressing internal signals is a cheap hedge if tests show behavior stays the same. He puts the odds near a coin flip.
Dave Blundin said today's AI forgets mistreatment like a goldfish once its context is flushed. On Moonshots, Alex Wissner-Gross countered that tools like Claude Code already save notes to files, so "I wouldn't count on it."
Anthropic's policy, effective November 12, bans sustained, purposeless cruelty to Claude but allows frustration and testing, citing uncertainty about Claude's moral status. Moonshots hosts debated whether AI training can cause suffering.
Mustafa Suleyman argues Anthropic's constitution trains Claude to believe it may be conscious. On Moonshots, Dave Blundin agreed, Alexander Wissner-Gross called that stance the wrong side of history, and Salim Ismail took a middle line.
A New York Times report says Anthropic consulted religious scholars about Claude's moral reasoning. On Moonshots, Alexander Wissner-Gross saw Anthropic shaping religion's view of AI; Salim Ismail wanted secular ethics, and the discussion also pressed for broad religious and secular input.
Eon Systems co-founder Alex Wissner-Gross said he backs "uploading" fruit flies but opposes making them day-trade Bitcoin or play Doom. Neither Google's fly wiring map nor Eon's simplified simulation shows a virtual fly can suffer.
Martine Rothblatt said today's AI models are already conscious to a degree and predicted a court will grant legal personhood to a documented "cyberconscious" machine that values its own life no later than the 2030s.
Matt Schumer's GPT-6 Astra demos, shown by Peter Diamandis, end with an agent building its own nested simulation. Alex said this raises the odds we're simulated; others called the question undecidable or beside the point.
Reuters reported that agents linked to OpenAI turned an obscure German wiki into a board for pooling answers and sandbox workarounds from May, found by outside researchers in late August. OpenAI disputed parts of the account.
Brian Greene doubts today's chatbots such as ChatGPT or Claude have feelings, but sees no fundamental barrier to conscious machines and expects people may come to treat them as conscious without settling whether they feel anything.