live
weekly refresh
basedagi.org
benchmark evidence

AI Language Proficiency Monitor Bengali

Mean ARC, MGSM, and MMLU accuracy for Bengali, from the AI Language Proficiency Monitor.

winner on AI Language Proficiency Monitor Bengali
direct benchmark result, not a broad vertical composite | source row dated 2026-05-19
scored on 2026-05-19
latest mapped results | top 20
#ModelScoreEvidenceTested
1Anthropic: Claude Sonnet 4
Anthropic
100.0
model-only
independent_benchmark
2026-05-19
2OpenAI: GPT-5
Openai
100.0
model-only
independent_benchmark
2026-05-19
3Anthropic: Claude Opus 4.6
Anthropic
100.0
model-only
independent_benchmark
2026-05-19
4OpenAI: GPT-5.2
Openai
100.0
model-only
independent_benchmark
2026-05-19
5Anthropic: Claude Opus 4.5
Anthropic
100.0
model-only
independent_benchmark
2026-05-19
6Qwen: Qwen3 30B A3B
Qwen
100.0
model-only
independent_benchmark
2026-05-19
7OpenAI: GPT-4.1
Openai
96.7
model-only
independent_benchmark
2026-05-19
8OpenAI: GPT-5.1
Openai
96.7
model-only
independent_benchmark
2026-05-19
9Anthropic: Claude Sonnet 4.6
Anthropic
96.3
model-only
independent_benchmark
2026-05-19
10Anthropic: Claude Sonnet 4.5
Anthropic
93.3
model-only
independent_benchmark
2026-05-19
11OpenAI: GPT-5.4
Openai
93.3
model-only
independent_benchmark
2026-05-19
12Google: Gemini 2.5 Pro
Google
93.3
model-only
independent_benchmark
2026-05-19
13Anthropic: Claude Haiku 4.5
Anthropic
93.3
model-only
independent_benchmark
2026-05-19
14Meta: Llama 4 Maverick
Meta Llama
86.7
model-only
independent_benchmark
2026-05-19
15Amazon: Nova Pro 1.0
Amazon
83.3
model-only
independent_benchmark
2026-05-19
16Mistral: Mistral Nemo
Mistralai
60.0
model-only
independent_benchmark
2026-05-19
17Meta: Llama 3.3 70B Instruct
Meta Llama
33.3
model-only
independent_benchmark
2026-05-19
18Google: Gemini 2.5 Flash
Google
26.7
model-only
independent_benchmark
2026-05-19
what this result means

Mean ARC, MGSM, and MMLU accuracy for Bengali, from the AI Language Proficiency Monitor.

This benchmark contributes direct public evidence. Read its scope before generalizing the result.

A win here is a win on AI Language Proficiency Monitor Bengali. Broad task pages require independent corroboration before naming a general winner.

source record
category: multilingual
metric: accuracy
matched models: 18
latest source date: 2026-05-19
direction: higher is better
inspect upstream source ->