BasedAGIBasedAGI
Menu
Rankings live

legal

Best LLM for Contract Review

Compare models for summarizing material changes between contract versions.

#1 Recommendation

gemini-2.5-pro

Strong on LEXam Leaderboard average_score_pct (89%) and FACTS Benchmark Suite facts_grounding_score_pct (100%)

external/google/gemini-2-5-pro

34.5%

Score

52.3%

Confidence

30

Evidence

Ranked Models

30

Evidence Quality

83%

Scoring

Benchmark-backed

Top Signal

LEXam Leaderboard: average_score_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gemini-2.5-pro

Strong on LEXam Leaderboard average_score_pct (89%) and FACTS Benchmark Suite facts_grounding_score_pct (100%)

34.5%
#2gemini-3-pro-preview

Strong on LEXam Leaderboard average_score_pct (76%) and FACTS Benchmark Suite facts_grounding_score_pct (88%)

33.7%
#3gpt-4.1-20250414

Strong on Vals Case Law v2 overall_accuracy_pct (86%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (82%)

24.8%
#4gpt-5-mini-2025-08-07
23.8%
#5anthropic/claude-sonnet-4.6
23.7%
#6gemini-2.5-flash
23.4%
#7google/gemini-3.1-pro-preview
21.9%
#8openai/gpt-5.4-2026-03-05
21.7%
#9Grok-4-0709
21.6%
#10gpt-5-2025-08-07
21.1%
#11claude-sonnet-4-20250514
20.2%
#12claude-opus-4-5-20251101
20.0%
#13gpt-5.1-2025-11-13
18.6%
#14gemini-3-flash-preview
18.5%
#15xai-org/grok-4-fast-reasoning
18.5%
#16google/gemini-3.1-flash-lite-preview
17.9%
#17xai-org/grok-4-1-fast-reasoning
17.5%
#20gpt-5.2-2025-12-11
15.5%
#21deepseek/deepseek-r1
15.3%
#22anthropic/claude-opus-4-6-thinking
15.2%
#23mistralai/mistral-large-2512
14.8%
#24anthropic/claude-opus-4-5-20251101-thinking
14.4%
#25x-ai/grok-3
14.3%
#26anthropic/claude-sonnet-4-5-20250929-thinking
13.6%
#27anthropic/claude-opus-4-1-20250805
13.4%
#30xai-org/grok-4-1-fast-non-reasoning
12.9%
#31zai/glm-5-thinking
12.9%
#32Command A (03-2025)
12.6%
#33kimi/kimi-k2.5-thinking
12.4%
#35grok/grok-4.20-beta-0309-reasoning
12.3%

Head-to-Head: #1 vs #2

#1

Top Pick

gemini-2.5-pro

Strong on LEXam Leaderboard average_score_pct (89%) and FACTS Benchmark Suite facts_grounding_score_pct (100%)

34.5%

Conf 52.3%

#2

gemini-3-pro-preview

Strong on LEXam Leaderboard average_score_pct (76%) and FACTS Benchmark Suite facts_grounding_score_pct (88%)

33.7%

Conf 45.2%

Related Lookups