SWE-bench
The industry measure: the share of real issues from open repositories closed without a human.
AI stopped suggesting one line at a time. It reads the whole project, plans a change, applies it across dozens of files and runs the tests itself.
The most advanced branch of the timeline: autonomy pays off fastest here because the result is immediately checkable by tests.
The industry measure: the share of real issues from open repositories closed without a human.
Systems plan and test complete changes instead of completing lines.
Triaging failed builds, fixing tests and bumping dependencies moved into the automated loop.
Writing code became cheaper than reviewing it — a bigger shift than generation itself.
Code nobody read accumulates faster than before. The industry has not yet seen what that costs in three years.
Moving from closing tickets to owning architecture: choosing trade-offs rather than executing decisions already made.
A product defined by requirements and tests, with code regenerated automatically and read by nobody.