benchmark evidence
BigCodeBench Complete
BigCodeBench bigcodebench-complete — practical Python coding benchmark.
winner on BigCodeBench Complete
direct benchmark result, not a broad vertical composite | source row dated 2000-01-01
scored on 2000-01-01 · stale source data (9646d)
latest mapped results | top 20
| # | Model | Score | Evidence | Tested |
|---|---|---|---|---|
| 1 | Meta: Llama 4 Maverick | 61.4 | model-only independent_benchmark | 2000-01-01 |
| 2 | Qwen2.5 Coder 32B Instruct | 58.0 | model-only independent_benchmark | 2000-01-01 |
| 3 | Meta: Llama 3.3 70B Instruct | 57.5 | model-only independent_benchmark | 2000-01-01 |
| 4 | Mistral: Mistral Small 4 | 46.6 | model-only independent_benchmark | 2000-01-01 |
| 5 | Meta: Llama 4 Scout | 43.1 | model-only independent_benchmark | 2000-01-01 |
what this result means
BigCodeBench bigcodebench-complete — practical Python coding benchmark.
This benchmark contributes direct public evidence. Read its scope before generalizing the result.
A win here is a win on BigCodeBench Complete. Broad task pages require independent corroboration before naming a general winner.
source record
category: coding
metric: pass_at_1
matched models: 5
latest source date: 2000-01-01
direction: higher is better