Jason Wei argues tool use cannot replace larger language models
Original titleWhen language models first started using tools well, I was sympathetic to the narrative that instead of scaling up language models, all w...
AISummary
Jason Wei now believes a small 1B-parameter "cognitive core" relying on tools is insufficient, because fast, natural recall without tool use matters.
He cites speed, knowledge better learned through backpropagation than retrieved from search, and the greater reliability of already-known facts over repeated lookups.
Since a 1B model has an information limit, he argues that demanding AI will still need larger models, not just tool access.
Source: Jason Wei · x.comPublished · added here