Deedy argues that benchmark scores for frontier AI models are increasingly meaningless because labs tune for them before launch. He suggests trusting price instead: a high price indicates a genuinely good model, while a low one suggests the model is benchmaxxed.
We’re at a point in late stage AI model capitalism where you know the frontier has to win in a bunch of benchmarks to launch. These numbers mean nothing.
The thing to trust is the price.
If they price it high, it’s a good model. If they don’t, it’s benchmaxxed.
Source: Deedy · x.comPublished · added here
