Heads up This site is currently under heavy development.
← all datasets
◆ Evals & benchmarks

SWE-bench Verified

license: see source

A 500-task subset of the SWE-bench test set, each issue human-validated as solvable and fairly tested — the version most coding-agent results are reported on.

Summary

Formats
parquet
License
license: see source
Added
2026-09-10

Get it

From the project’s own instructions where it documents any; otherwise a plain clone.

  1. Download from huggingface.co ↗

    No single download: pick the files you need from the source page.

my-toolchain — 0 tools
paste an install list to detect your tools

A brew list, a Brewfile, requirements.txt, a Dockerfile — or just the product names, free-form. Nothing leaves your browser.

    browse all tools →

    Send us feedback