OpenAI releases SWE-bench Verified
On August 13, 2024, OpenAI released SWE-bench Verified, a 500-sample human-validated subset of SWE-bench built with the benchmark's original authors from Princeton, after filtering ambiguous tasks and unreliable tests.