Introducing SWE-bench Verified

OpenAI is releasing a human-validated subset of SWE-bench to better evaluate AI models on real-world software issues.

From the source
We’re releasing a human-validated subset of SWE-bench that more reliably evaluates AI models’ ability to solve real-world software issues.
openai.com

Visit source ↗openai.com

Announced: 13 Aug 2024 10:00 UTC
Detected: 03 Aug 2026 21:11 UTC (+720d after)

Other stories

OpenAI · 31 AugPolimill builds Japan's next-generation public AI infrastructure

OpenAI · 31 AugA milestone in expanding access to AICompany news

OpenAI · 28 AugOur decision on Cursor following its acquisition by SpaceX

OpenAI · 28 AugSupporting Thailand’s next generation of AI startupsPartnership

Google Research · 27 AugPlanetary prediction engine: Automating global models via Earth AI

Research paper

OpenAI · 27 AugBetter answers, broader thinking: What students gain from ChatGPT and critical-thinking trainingResearch paper