live
weekly refresh
basedagi.org
benchmark evidence

AI Language Proficiency Monitor Average

Mean accuracy across ARC, MGSM, and MMLU in ten target languages, from the AI Language Proficiency Monitor.

winner on AI Language Proficiency Monitor Average
direct benchmark result, not a broad vertical composite | source row dated 2026-05-19
scored on 2026-05-19
latest mapped results | top 20
#ModelScoreEvidenceTested
1Anthropic: Claude Opus 4.6
Anthropic
98.3
model-only
independent_benchmark
2026-05-19
2OpenAI: GPT-5.2
Openai
97.7
model-only
independent_benchmark
2026-05-19
3Anthropic: Claude Sonnet 4.6
Anthropic
97.5
model-only
independent_benchmark
2026-05-19
4OpenAI: GPT-5
Openai
97.2
model-only
independent_benchmark
2026-05-19
5Anthropic: Claude Opus 4.5
Anthropic
96.7
model-only
independent_benchmark
2026-05-19
6Anthropic: Claude Sonnet 4
Anthropic
96.0
model-only
independent_benchmark
2026-05-19
7OpenAI: GPT-5.1
Openai
95.3
model-only
independent_benchmark
2026-05-19
8Anthropic: Claude Sonnet 4.5
Anthropic
95.3
model-only
independent_benchmark
2026-05-19
9Qwen: Qwen3 30B A3B
Qwen
95.1
model-only
independent_benchmark
2026-05-19
10OpenAI: GPT-5.4
Openai
94.9
model-only
independent_benchmark
2026-05-19
11Google: Gemini 2.5 Pro
Google
94.3
model-only
independent_benchmark
2026-05-19
12Anthropic: Claude Haiku 4.5
Anthropic
94.0
model-only
independent_benchmark
2026-05-19
13OpenAI: GPT-4.1
Openai
92.7
model-only
independent_benchmark
2026-05-19
14Amazon: Nova Pro 1.0
Amazon
90.3
model-only
independent_benchmark
2026-05-19
15Meta: Llama 4 Maverick
Meta Llama
88.3
model-only
independent_benchmark
2026-05-19
16Meta: Llama 3.3 70B Instruct
Meta Llama
79.3
model-only
independent_benchmark
2026-05-19
17Mistral: Mistral Nemo
Mistralai
61.0
model-only
independent_benchmark
2026-05-19
18Google: Gemini 2.5 Flash
Google
34.3
model-only
independent_benchmark
2026-05-19
what this result means

Mean accuracy across ARC, MGSM, and MMLU in ten target languages, from the AI Language Proficiency Monitor.

This benchmark contributes direct public evidence. Read its scope before generalizing the result.

A win here is a win on AI Language Proficiency Monitor Average. Broad task pages require independent corroboration before naming a general winner.

source record
category: multilingual
metric: accuracy
matched models: 18
latest source date: 2026-05-19
direction: higher is better
inspect upstream source ->