Tag
Briefings and ideas about Inference costs from AI podcast discussions and the research they cite, with links to the original sources.
Anthropic's Thariq Shihipar says Claude Mods, publicly proposed in September, would run user code inside Claude Code for automatic quizzes, assumption logs and model routing. The interview also raised cache-cost and complexity worries.
In one DrivingBench session, OpenAI's GPT-6 Astra drove a real Corolla through a cone course on its second try. Alexander Wissner-Gross said specialist robotics models are unnecessary; Dave Blundin questioned reliability and compute cost.
OpenAI researcher Noam Brown says multi-agent coordination deserves not even 10% of the credit for the claimed Navier–Stokes result. He adds that OpenAI has not run a single-agent comparison or measured what 10,000 agents added.
Box CEO Aaron Levie says the big labs' revenue and open-weight token use can grow together, as agents split work so cheaper models handle far more tokens. He sees enterprise open-weight adoption as early, driven partly by hedging.
John Schulman expects frontier AI models to keep growing as compute and GPUs expand. Charlie O’Neill expects little parameter growth for a few years, because long reinforcement-learning runs reward cheap inference.
Panelists on Moonshots argue that as agent compute gets cheaper, the scarce skill is choosing targets: OpenAI's claimed Navier–Stokes proof was easy to specify, but models asked for ideas to cure cancer return poor lists.
DeepSeek says V4.1-Flash's KV cache needs a quarter of the HBM and an eighth of the SSD cache of its prior generation. Moonshots panelists argued that changes what AI data centers should buy; one estimated HBM is 40% of US buildout spending.
Emad Mostaque called for AI tokens for everybody and 100 million government-underwritten robots owned by the people. Alex, who predicts "universal basic tokens," said Americans should own robots individually, not through a centralized state.
OpenAI says an internal model running about 10,000 agents for 88 hours produced a forced Navier–Stokes blowup construction with a Lean-checked proof. Moonshots panelists stressed it concerns idealized fluids and noted disputes over credit.
Anthropic's Fable 5.1 cuts cached reads to $0.25 per million tokens, a quarter of Fable 5's rate. A Moonshots panelist said this makes a company's reused context the prize, as model leads last only about a month.
OpenAI's GPT-6 Astra nearly saturates ARC-AGI-3 and tops Epoch AI's index but ranks third by vendor family on Artificial Analysis's. Moonshots panelist Alex, lacking access, suspects it was built for fast, low-token computer use.
David Friedberg argued that open-weight AI models will keep value from pooling in two or three labs, betting someone with zero net worth today will become a billionaire within 10 years by building on downloaded open-source AI.