Best AI for coding: 97% on one benchmark, 61.5% on a harder one
Seven models sit above 95% on SWE-bench Verified. On repositories picked so they were unlikely to have trained on them, the best score is 61.5%. We read four leaderboards, one controlled trial and three vendor pricing pages.
Read More