Cognition's Devin review says it excels at scoped junior-level engineering work
Original titleDevin's 2025 Performance Review: Learnings From 18 Months of Agents At Work
Cognition's 2025 performance review says Devin works best on clear, verifiable tasks such as migrations, vulnerability fixes, and unit tests.
The company reports a 67% PR merge rate, up from 34% last year, and cites a bank that cut migration time per file from 30-40 hours to 3-4 hours.
It also says Devin struggles with ambiguous requirements, mid-task scope changes, and soft-skill work that still needs human engineers.
The report pairs concrete migration, vulnerability, and test-coverage figures with named weaknesses, letting engineering leaders judge where an agent fits in their own workflow.
Source: Cognition Blog (Devin, Windsurf) · cognition.comPublished · added here