Tag
Briefings and ideas about Data centers from AI podcast discussions and the research they cite, with links to the original sources.
Peter Diamandis, after meeting SK hynix and Solidigm leaders, argued memory, not GPUs, now limits AI. Panelists blamed new AI workloads and bust-wary suppliers, and floated etching model weights into chips as a possible fix.
Moonshots panelist Alex floated a hypothetical in which OpenAI rents Jalapeño inference-chip capacity to rivals, after the panel relayed OpenAI's own claimed gains over NVIDIA chips and argued inference is moving off NVIDIA.
X says it found 200 accounts in a suspected 200,000-account Chinese bot farm posting claims that AI data centers raise power bills. Moonshots hosts contrasted Quincy, Washington, where data-center taxes funded a school and hospital.
NVIDIA reported $96.2 billion in quarterly revenue, up 106%, and guided to $108 billion. On Moonshots, Alexander Wissner-Gross asked how much of that demand NVIDIA financed itself; Dave Blundin argued it will stay sold out.
The viral figure of 627 million gallons a day for data-center water matches Berkeley Lab's 2023 national estimate, but most is consumed at power plants and it can't show what one proposed site would draw locally.
Emad Mostaque argued on Moonshots that NVIDIA's reported $6 billion open-model deal with Poolside is about driving GPU demand. Panelists split on whether such licensing-and-hiring deals dodge antitrust scrutiny or merger-review delays.
Sam Altman said economic inertia made AI's impact slower than he expected after GPT-4. On Moonshots, Salim Ismail blamed slow institutions, Alexander Wissner-Gross abstraction layers, and Emad Mostaque models that only recently got good.
Critic Ed Zitron predicts OpenAI runs out of cash in 2027, with losses spreading to SoftBank, Oracle, cloud giants and index-linked retirement savings. Amazon's Andy Jassy says its capital spending is backed by customer commitments.
Economist Steve Keen argued that the sheer cost of frontier AI and the physical resources it needs may be what slows the race, and forecast that the one company left standing will be Chinese rather than American.
Alvin Wang Graylin, speaking personally on Moonshots, says US–China AI talks need not reach a solution on day one and should start with an emergency hotline, shared safety tests and agreement to keep talking.
Alvin Graylin argues cheaper open models and local computing could erode the cloud revenues that AI data center debt relies on, likening NVIDIA's plan to mobilize over $500 billion in outside financing to subprime lending, as a warning, not proof.
Ramez Naam says AI demand could finance multi-plant nuclear orders that may lower costs, but doubts small reactors can supply power within the five-year window he sees as predictable, and expects their roughly 2030 schedules to slip.