Aakanksha Chowdhery argues pre-training limits agentic AI, not post-training
AIReflection AI technical staff member Aakanksha Chowdhery argues that the bottleneck for agentic AI is pre-training itself rather than post-training fixes. Drawing on her work on PaLM and early Gemini, she says next-token prediction breaks down for long-horizon planning and that objectives, attention, and training data must evolve.