Tag
Briefings and ideas about AI pricing from AI podcast discussions and the research they cite, with links to the original sources.
At DevDay, OpenAI API product lead Nikunj Handa said GPT-6 lets agents keep reasoning while tools run and take new instructions mid-task. He also described longer cache guarantees, one still in preview, and open questions about the platform.
Box CEO Aaron Levie says the big labs' revenue and open-weight token use can grow together, as agents split work so cheaper models handle far more tokens. He sees enterprise open-weight adoption as early, driven partly by hedging.
Panelists on Moonshots argue that as agent compute gets cheaper, the scarce skill is choosing targets: OpenAI's claimed Navier–Stokes proof was easy to specify, but models asked for ideas to cure cancer return poor lists.
H100 rental prices rose 22% in a month to $3.28 per GPU-hour on Ornn's transaction index. Dave Blundin, whose fund backs Ornn, called it a reversal of chip depreciation; Emad Mostaque said better models make old Hoppers more useful.
DeepSeek says V4.1-Flash's KV cache needs a quarter of the HBM and an eighth of the SSD cache of its prior generation. Moonshots panelists argued that changes what AI data centers should buy; one estimated HBM is 40% of US buildout spending.
Emad Mostaque called for AI tokens for everybody and 100 million government-underwritten robots owned by the people. Alex, who predicts "universal basic tokens," said Americans should own robots individually, not through a centralized state.
Anthropic's Fable 5.1 cuts cached reads to $0.25 per million tokens, a quarter of Fable 5's rate. A Moonshots panelist said this makes a company's reused context the prize, as model leads last only about a month.
David Friedberg argued that open-weight AI models will keep value from pooling in two or three labs, betting someone with zero net worth today will become a billionaire within 10 years by building on downloaded open-source AI.
Moonshots panelists debated a relayed claim that 70% of China's AI token use goes to video: Alex Wissner-Gross said US labs chase revenue per token, and Dave Blundin that video sells where enterprises won't trust Chinese models.
Salim Ismail argued Apple's 512GB Mac Studio turns AI spending from a per-token bill into an owned capital asset for law firms and mid-sized healthcare groups. Fellow panelist Dave called it a tiny step by a company he says has no AI strategy.
AI critic Ed Zitron argues chatbots help with small tasks but aren't worth trillions, and that subscriptions hide what usage costs. He asks whether users like the host's fiancée would pay the real per-token price.
Parag Agrawal says Parallel entered web search by selling a search agent that crawled after each request, replacing outsourced human research, and treating an index as a latency optimization to build later.