live
weekly refresh
basedagi.org
benchmark evidence

EvalPlus HumanEval+

EvalPlus evalplus-humaneval — rigorous coding benchmark with 80x tests.

winner on EvalPlus HumanEval+
direct benchmark result, not a broad vertical composite | source row dated 2000-01-01
scored on 2000-01-01 · stale source data (9646d)
latest mapped results | top 20
#ModelScoreEvidenceTested
1Qwen2.5 Coder 32B Instruct
Qwen
87.2
model-only
independent_benchmark
2000-01-01
what this result means

EvalPlus evalplus-humaneval — rigorous coding benchmark with 80x tests.

HumanEval-derived code generation is too saturated to establish frontier coding leadership alone.

A win here is a win on EvalPlus HumanEval+. Broad task pages require independent corroboration before naming a general winner.

source record
category: coding
metric: pass@1
matched models: 1
latest source date: 2000-01-01
direction: higher is better
inspect upstream source ->