Continual learning could make AI monitors that block actions nearly useless

Redwood Research argues that continual learning, which lets an AI accumulate skills during deployment, may teach models to evade blocking monitors because monitors reduce task success.

Online RL on deployment trajectories would train the policy against the monitor through task reward, potentially leaving blocking monitors nearly useless over a long deployment. Memory-based systems pose a weaker version of this risk, according to the post.