BasedAGIBasedAGI
Menu
Rankings live

legal

Legal translation

Translate legal text with terminology consistency and format safety.

#1 Recommendation

gemini-2.5-flash

Strong on LanguageBench Translation Official (Split) translation_to:bleu (92%) and LanguageBench overall:mean (100%)

external/google/gemini-2-5-flash

31.1%

Score

35.1%

Confidence

Limited benchmark evidence for this use case.

54 ranked models with average evidence of 14.4 points. Rankings may shift as more benchmark data is ingested.

Ranked Models

30

Evidence Quality

81%

Scoring

Benchmark-backed

Top Signal

LanguageBench Translation Official (Split): translation_to:bleu

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gemini-2.5-flash

Strong on LanguageBench Translation Official (Split) translation_to:bleu (92%) and LanguageBench overall:mean (100%)

31.1%
#4gemini-2.5-pro
25.3%
#5gpt-4.1-20250414
25.1%
#7google/gemini-2.0-flash-001
23.6%
#11gemini-3-pro-preview
19.1%
#15gpt-5-mini-2025-08-07
17.7%
#16deepseek/deepseek-r1
17.2%
#19claude-sonnet-4-20250514
15.9%
#22google/gemini-3.1-pro-preview
15.6%
#23anthropic/claude-sonnet-4.6
15.3%
#24gpt-4.1-mini-20250414
15.2%
#25gpt-5-2025-08-07
15.0%
#27openai/gpt-5.4-2026-03-05
14.9%
#28Grok-4-0709
14.9%
#29Llama-3.1-70B-Instruct
14.7%
#30Llama-3.3-70B-Instruct
13.7%
#32claude-opus-4-5-20251101
13.1%
#33gpt-5.1-2025-11-13
13.0%
#34xai-org/grok-4-fast-reasoning
13.0%
#35gemini-3-flash-preview
12.9%
#36xai-org/grok-4-1-fast-reasoning
12.2%
#37google/gemini-3.1-flash-lite-preview
11.8%
#38phi-4
11.7%
#41gpt-4o
11.3%
#42mistralai/mistral-large-2512
10.9%
#43gpt-5.2-2025-12-11
10.8%
#46anthropic/claude-opus-4-1-20250805
10.7%
#48anthropic/claude-opus-4-6-thinking
10.5%
#49Command A (03-2025)
10.5%
#51anthropic/claude-opus-4-5-20251101-thinking
10.4%

Compare Models

Model A leads by +5.8%

Shareable Link →

Model A

gemini-2.5-flash

external/google/gemini-2-5-flash

31.1%

Rank #1

Confidence 35.1%20 evidence pts

LanguageBench Translation Official (Split): translation_to:bleu

Value 92.0% · Conf 100.0% · Weight 5.5%

languagebench_translation_official.translation_to_bleu (Mar 12, 2026)

LanguageBench: overall:mean

Value 100.0% · Conf 100.0% · Weight 3.5%

languagebench.overall_mean (Mar 12, 2026)

LanguageBench Translation Official (Split): translation_to:chrf

Value 97.5% · Conf 100.0% · Weight 3.0%

languagebench_translation_official.translation_to_chrf (Mar 12, 2026)

Galileo Agent Leaderboard v2: Avg TSQ

Value 100.0% · Conf 100.0% · Weight 2.7%

galileo_agent_v2.avg_tsq (Mar 12, 2026)

Model B

gemini-2.5-pro

external/google/gemini-2-5-pro

25.3%

Rank #4

Confidence 50.3%30 evidence pts

LEXam Leaderboard: average_score_pct

Value 89.4% · Conf 100.0% · Weight 2.5%

lexam_leaderboard.average_score_pct (Mar 12, 2026)

Galileo Agent Leaderboard v2: Avg TSQ

Value 79.5% · Conf 100.0% · Weight 2.1%

galileo_agent_v2.avg_tsq (Mar 12, 2026)

Vals Case Law v2: overall_accuracy_pct

Value 63.2% · Conf 100.0% · Weight 2.1%

vals_case_law_v2.overall_accuracy_pct (Mar 12, 2026)

OpenVLM OCRBench Official: ocrbench_score_pct

Value 90.7% · Conf 100.0% · Weight 1.8%

openvlm_ocrbench_official.ocrbench_score_pct (Mar 12, 2026)

Ranking Diagnostics & Missing Models

Source Lift

Ranked

54

Sources

8

Quality

Insufficient

Vals Legal Bench

vals_legal_bench

41 rows

2.4% avg lift

Vals MedQA

vals_medqa

38 rows

0.4% avg lift

Vals Tax Eval v2

vals_tax_eval_v2

38 rows

0.4% avg lift

Vals LiveCodeBench

vals_lcb

37 rows

0.3% avg lift

Missing Strong Models

gpt-4o-2024-05-13

external/openai/gpt-4o-2024-05-13

Rank #51

10.5%

Thin evidence after weighting
Taxonomy Details

Core Tasks

task.translate_technicaltask.glossary_terminology_consistency

Required Modes

mode.multilingualmode.format_preservation

Domains

domain.legal_regulatorydomain.legal_contracts

Related Use Cases