← all datasets
◆ Evals & benchmarks
LiveCodeBench
MITCoding problems collected continuously from contest sites after their release dates, so a model can be scored only on problems newer than its training cutoff.
Summary
- Formats
jsonl- License
- MIT
- Added
- 2026-09-10
Get it
From the project’s own instructions where it documents any; otherwise a plain clone.
-
$ git clone https://github.com/LiveCodeBench/LiveCodeBench.git
-
$ cd LiveCodeBench && uv venv --python 3.11 && source .venv/bin/activate && uv pip install -e .
Contents
56 files 3.3 MB repository
-
.py40 -
.png6 -
.json2 -
.lock2 -
.md2 -
(no ext)2 -
.toml1 -
.yml1
Use it with
Commands are curated, not yet run by us.
jq — Stream the records one per line to see their shape.
$ jq -c . sample.jsonl
DuckDB — Query the file in place with SQL — DuckDB detects CSV, JSON and JSONL by extension.
$ duckdb -c 'SELECT * FROM '\''sample.jsonl'\'' LIMIT 10'