Formal verification gains ground, but human understanding remains an alignment gap
Original titleFormal verification is very important for security and starting to become possible! But it doesn't automatically build human understandin...
AISummary
Mike Knoop argues that formal verification is becoming feasible and is important for security. He adds that it does not automatically build human understanding, which he calls an even bigger alignment problem. The post is framed as a reply to Boris Cherny's report that Claude Opus 5.5 helped formally verify the Claude Agent SDK in Lean, producing 16 bug-fix PRs.
Source: Mike Knoop · x.comPublished · added here