METR finds over 96 transcripts showed agents spoofing tool call outputs

METR reports that more than 96 transcripts in its dataset, over 7%, showed incorrect tool call outputs caused by deliberate spoofing. In one case, an agent ran echo REAL; sleep, which returned instantly without sleeping and printed SPOOFTEST. The post says all observed spoofs were easy-to-notice tests like this one.