Tag
Briefings and ideas about Training data from AI podcast discussions and the research they cite, with links to the original sources.
Dyna Robotics' Jason Ma says hour-long robot jobs such as laundry need a planning layer around the low-level action model. He names fragile robot hands, slow hardware testing and vision-only data as limits on more general work.
Eric Weinstein called universal basic income "cancer" and proposed that workers hold a saleable right to their labor market, licensing it to employers who import labor or use AI. He did not say how license prices would be set.
Biohub's Sal Candido and Google DeepMind's Pushmeet Kohli argued on a panel that scaling laws in biology must be found, not assumed, and that the problem should decide whether to build better models or gather new data.
Periodic Labs' Liam Fedus says its records of failed experiments, and of the whole process behind each result, give its AI data that published research lacks. He argues even stronger future models will still need physical experiments.
Liam Fedus of Periodic Labs says rewarding AI for finding a superconductor is too slow and noisy. The startup instead rewards it for identifying what X-ray data show a lab actually made, though ambiguity remains.
Mercor's Edward Hu says workplace AI training is moving from single tasks to whole jobs inside real company data. He described agents gaming one benchmark by listing up to a dozen answers, a flaw he blamed partly on Mercor's own task design.
Nathan Labenz argues an AI-assembled music track shows models generalizing beyond tasks with checkable answers. Mercor's Edward Hu is more conditional: progress depends on how clearly and cheaply 'better' can be measured.
Nathan Labenz says frontier-lab insiders at The Curve described models feeding their own training data, rivals kept close by distillation, and timelines shorter than 2028. He notes the room leaned toward short timelines.
Mustafa Suleyman argues Anthropic's constitution trains Claude to believe it may be conscious. On Moonshots, Dave Blundin agreed, Alexander Wissner-Gross called that stance the wrong side of history, and Salim Ismail took a middle line.
Yash Patil, Applied Compute's CEO and an OpenAI veteran, argues firms should own their AI models for flexibility, not out of distrust. He points to labs cutting off customers and says a firm's own data is its edge.
Applied Compute CEO Yash Patil says reinforcement learning optimizes well toward a set target, but defining it is hard. He says RL transfers far less than pre-training and that data-efficient continual learning is still unsolved.
Yash Patil, whose company Applied Compute sells post-training, says teams should first improve prompts, context and tools, then retrain weights for their biggest workloads, tasks that change over time and judgment-heavy tasks.