Tag
Briefings and ideas about GPUs from AI podcast discussions and the research they cite, with links to the original sources.
MIT PhD student Alex Zhang said AI generates nearly all recent GPU Mode leaderboard solutions, yet one expert's AI-steered kernel was essentially the only top-10 entry stable end to end. He argues experts remain strong verifiers.
Steve Hou of Silicon Data said big clouds charge at least two to three times neocloud GPU rates for bundled services. He guessed a recent rise in its token index reflects which models people use, not price hikes.
Edouard Harris says that after a serious AI incident, the US could today realistically ask China only to switch off large, visible computing clusters. He argues cheaper, pre-vetted verification is needed first.
OpenAI researcher Noam Brown says AI could make AI research perhaps three times faster. He argues that, unlike maths, research waits on sequential experiments and GPUs, so he doubts a 100-fold jump, and says his uncertainty is large.
John Schulman expects frontier AI models to keep growing as compute and GPUs expand. Charlie O’Neill expects little parameter growth for a few years, because long reinforcement-learning runs reward cheap inference.
H100 rental prices rose 22% in a month to $3.28 per GPU-hour on Ornn's transaction index. Dave Blundin, whose fund backs Ornn, called it a reversal of chip depreciation; Emad Mostaque said better models make old Hoppers more useful.
DeepSeek says V4.1-Flash's KV cache needs a quarter of the HBM and an eighth of the SSD cache of its prior generation. Moonshots panelists argued that changes what AI data centers should buy; one estimated HBM is 40% of US buildout spending.
Nvidia's Jensen Huang declared AGI achieved on September 6 as he announced more GPU capacity, and the Moonshots panel split on what the label means. OpenAI's figure of 3.1 agent research days per human day measures runtime, not finished work.
Peter Diamandis, after meeting SK hynix and Solidigm leaders, argued memory, not GPUs, now limits AI. Panelists blamed new AI workloads and bust-wary suppliers, and floated etching model weights into chips as a possible fix.
Anthropic is reportedly weighing super-voting shares to keep founders in control after its IPO, per The Information. A Moonshots panel splits over who really steers a frontier AI lab: founders, its benefit trust or market pressure.
Moonshots panelist Alex floated a hypothetical in which OpenAI rents Jalapeño inference-chip capacity to rivals, after the panel relayed OpenAI's own claimed gains over NVIDIA chips and argued inference is moving off NVIDIA.
NVIDIA reported $96.2 billion in quarterly revenue, up 106%, and guided to $108 billion. On Moonshots, Alexander Wissner-Gross asked how much of that demand NVIDIA financed itself; Dave Blundin argued it will stay sold out.