Epoch AI lists nine big AI questions its benchmarks aim to answer
Original title9 Big questions benchmarks can help answer
AISummary
Epoch AI outlines nine open questions about AI capabilities, including whether AI can take over full jobs and whether benchmark scores are correlated.
The author says Epoch's benchmarking work is built to help answer them, citing examples such as MirrorCode, Remote Labor Index, and the Epoch Capabilities Index (ECI).
The post notes that benchmark scores are highly correlated across domains, and that ECI growth trends can help detect whether AI capability progress has accelerated.
Source: Epoch AI · The Epoch Brief · epochai.substack.comPublished · added here