Devin Tests Its Own Code Changes in the Cloud and Returns Proof

Cognition describes autonomous testing in Devin, where the agent writes a source-grounded test plan, operates the app through computer use, and returns labeled screenshots and an annotated video.

Login steps are handled by a deterministic testing skill, and the company says test runs approved per day more than doubled in recent months.

Known limits include timing errors with transient UI elements and models sometimes triggering states through JavaScript instead of clicking the interface.