16 September 2026
Heard In AI

Tag

Context windows

Articles about Context windows from podcasts, articles and papers, with links to the original sources.

Anthropic's cheaper cached reads make business context the prize

Anthropic's Fable 5.1 charges $0.25 per million tokens for cached reads, a quarter of the previous rate, which one Moonshots panelist read as an invitation to load an entire company's context into the model and keep it there. The panel connected that price to a wider scramble: with model leads lasting about a month, the labs are racing to convert them into customer workflows, partnerships and proprietary design data that a rival cannot copy.

5 min read

Altman says AGI by year-end; the panel wants agents that stop forgetting

A TIME report has Sam Altman expecting an internal system he would call AGI within four months, and OpenAI's chief scientist saying its unreleased Astra model has met an internal benchmark for an automated research intern. On the Moonshots panel, the label mattered less than a practical test: whether the next model can finally keep hold of what it has learned over a long job, instead of handing a summary to a successor and starting again.

6 min read

A 100x claim lands, and the panel hits a harder question: coordinating 10,000 agents

On Moonshots, the panel revisits Elon Musk's January prediction that models were "off by two orders of magnitude" in intelligence per gigabyte, after Tim Sweeney tweeted that it had come true and Musk replied that specialist AIs add another 100x. Dave calls 100x a lower bound and asks what anyone would actually do with 10,000 brilliant agents; Emad Mostaque describes running specialized agent teams, while Alex argues Musk's "specialist models" are really sparsification inside generalist models.

6 min read

Parallel sold patient search agents before it could afford a web index

On Training Data, Parag Agrawal explains how his company Parallel entered web search without first building a giant index: it launched a search agent that crawled after a request arrived, replaced outsourced human data collection for insurance, sales and finance customers, and treated the index as a latency optimization to be grown later. He describes the agent-specific architecture behind it, the 200-millisecond Turbo mode Parallel announced in July, and a Google Cloud deal that puts Parallel Search beside Google Search as a grounding option.

7 min read