# OpenAI — Introducing SWE-bench Verified

- Company: OpenAI (openai.com)
- Announced: 2024-08-13T10:00:00+00:00
- Category: research-paper
- Subject: GPT / ChatGPT / API
- Source: https://openai.com/index/introducing-swe-bench-verified
- Record: https://forck.live/items/725-introducing-swe-bench-verified

OpenAI is releasing a human-validated subset of SWE-bench to better evaluate AI models on real-world software issues.

## Evidence

Verbatim from https://openai.com/index/introducing-swe-bench-verified:

> We’re releasing a human-validated subset of SWE-bench that more reliably evaluates AI models’ ability to solve real-world software issues.

---

Record: https://forck.live/items/725-introducing-swe-bench-verified
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md