Rich Sutton and Khurram Javed want deployed AI to change its underlying weights from individual experience, rather than rely on extra context or shared model updates. Their Oak Lab agenda combines learning rates tailored to each weight with a way to refresh a network’s capacity to learn—supported by earlier experiments, but not yet a demonstrated general-purpose system.
Naam predicts that AI-assisted code conversion could weaken NVIDIA’s software lock-in in 2026–2027, making rival chips easier to use. The panel’s counterargument: fast connections between chips still matter, even when the work shifts from training models to answering users.
xAI’s August 12 release puts Grok 4.6 alongside GPT-5.6 Sol Max in its launch benchmark table, with pricing aimed at sustained agent work. The Moonshots panel’s debate was about the next step: whether training on other models’ reasoning can only help a challenger catch up, and what computing infrastructure it takes to move beyond that.