Heads up This site is currently under heavy development.
← all datasets
◆ Evals & benchmarks

Aider Polyglot Benchmark

license: see source

Exercism coding exercises in C++, Go, Java, JavaScript, Python and Rust, used for aider's code-editing leaderboard. Unmaintained since 2024.

Summary

This repository contains a curated collection of programming exercises extracted from Exercism's language tracks. These exercises are used for benchmarking and testing purposes.
from the project README
Formats
source
License
license: see source
Added
2026-09-10

Get it

From the project’s own instructions where it documents any; otherwise a plain clone.

  1. shell
    $ git clone --depth 1 https://github.com/Aider-AI/polyglot-benchmark

    Shallow clone: history isn’t needed for testing.

Contents

2,357 files 1.1 MB repository

  • .md 360
  • .json 297
  • .toml 231
  • .java 199
  • .js 196
  • (no ext) 195
  • .go 169
  • .py 105
my-toolchain — 0 tools
paste an install list to detect your tools

A brew list, a Brewfile, requirements.txt, a Dockerfile — or just the product names, free-form. Nothing leaves your browser.

    browse all tools →

    Send us feedback