Tag
Briefings and ideas about Language models from AI podcast discussions and the research they cite, with links to the original sources.
Alexander Wissner-Gross told a founder whose AI language companion kept slipping into assistant mode to try fine-tuning; Dave Blundin suggested an open-weight GLM model and said learners want to be fluent and funny, not just correct.
Robinhood CEO Vlad Tenev said its Agentic Trading accounts are currently used mostly for automation, with agents assembling and executing trades customers already chose; he did not claim they beat professional quant funds.
OpenAI researcher Noam Brown says AI could make AI research perhaps three times faster. He argues that, unlike maths, research waits on sequential experiments and GPUs, so he doubts a 100-fold jump, and says his uncertainty is large.
Panelists split over whether OpenAI's Navier–Stokes proof means AI will soon improve AI research; a skeptic called math narrower, while a risk-focused guest gave about 10% odds a bigger agent swarm designs a better AI architecture in six months.
Martine Rothblatt says her Marvatar, trained on her words and commercial LLMs, answers questions from 2,000 United Therapeutics staff around the clock. She argues such records can recreate a person without mapping neurons, an unproven claim.
Martine Rothblatt said today's AI models are already conscious to a degree and predicted a court will grant legal personhood to a documented "cyberconscious" machine that values its own life no later than the 2030s.
Box CEO Aaron Levie says shifting access permissions, like a lawyer walled off from rival matters, complicate training company knowledge into model weights. He wants a rubric on what to bake in and expects answers to vary by domain.
Box CEO Aaron Levie says the big labs' revenue and open-weight token use can grow together, as agents split work so cheaper models handle far more tokens. He sees enterprise open-weight adoption as early, driven partly by hedging.
Alexander Wissner-Gross argued next-word prediction as a training task may last indefinitely, while the transformer architecture is already being replaced piece by piece. Another panelist guessed chips move to photonics in 18 months to two years.
The Moonshots AMA panel told caregiver-founder John Regan that exhausted family caregivers should start with AI day planning, then voice systems, and only later robots. No one on the call reported results from the approach.
Moonshots hosts told mid-career professionals with mortgages to brainstorm spare-time AI experiments with a language model, tinker at night, find online peers, try Mercor and schedule slack time; none of it shows an income can be replaced.
On the Dwarkesh Podcast, AI researchers argued that pass/fail rewards work because earlier training supplies candidate behaviors and rewards ignore incidental wording. Charlie O'Neill warned that harder training tasks cost ever more to build.