BasedAGIBasedAGI
Menu
Rankings live

legal

Best LLM for Regulatory Summary

Ranked models for summarizing regulatory text with conservative interpretation.

#1 Recommendation

gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and LEXam Leaderboard average_score_pct (89%)

external/google/gemini-2-5-pro

32.7%

Score

50.9%

Confidence

30

Evidence

Runners-up:#2 gemini-3-pro-preview (32.4%)#3 gpt-4.1-20250414 (27.5%)#4 gpt-5-mini-2025-08-07 (24.9%)

Ranked Models

30

Evidence Quality

84%

Scoring

Benchmark-backed

Top Signal

FACTS Benchmark Suite: facts_grounding_score_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and LEXam Leaderboard average_score_pct (89%)

32.7%
#2gemini-3-pro-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct (88%) and Vals Legal Bench overall_accuracy_pct (99%)

32.4%
#3gpt-4.1-20250414

Strong on MMLongBench-Doc Leaderboard acc_score_pct (75%) and Vals Case Law v2 overall_accuracy_pct (86%)

27.5%
#4gpt-5-mini-2025-08-07
24.9%
#5anthropic/claude-sonnet-4.6
24.8%
#6gemini-2.5-flash
24.5%
#7google/gemini-3.1-pro-preview
22.9%
#8openai/gpt-5.4-2026-03-05
22.7%
#9Grok-4-0709
22.6%
#10gpt-5-2025-08-07
22.0%
#11claude-sonnet-4-20250514
21.1%
#12claude-opus-4-5-20251101
20.9%
#13gpt-5.1-2025-11-13
19.5%
#14gemini-3-flash-preview
19.3%
#15xai-org/grok-4-fast-reasoning
19.3%
#16google/gemini-3.1-flash-lite-preview
18.7%
#17xai-org/grok-4-1-fast-reasoning
18.3%
#18gpt-5.2-2025-12-11
16.2%
#19anthropic/claude-opus-4-6-thinking
15.9%
#20mistralai/mistral-large-2512
15.5%
#21anthropic/claude-opus-4-5-20251101-thinking
15.0%
#22x-ai/grok-3
15.0%
#23anthropic/claude-sonnet-4-5-20250929-thinking
14.3%
#24anthropic/claude-opus-4-1-20250805
14.1%
#28xai-org/grok-4-1-fast-non-reasoning
13.5%
#29zai/glm-5-thinking
13.5%
#30Command A (03-2025)
13.2%
#31kimi/kimi-k2.5-thinking
13.0%
#32grok/grok-4.20-beta-0309-reasoning
12.9%
#34Kimi K2 Thinking
12.7%

Head-to-Head: #1 vs #2

#1

Top Pick

gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and LEXam Leaderboard average_score_pct (89%)

32.7%

Conf 50.9%

#2

gemini-3-pro-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct (88%) and Vals Legal Bench overall_accuracy_pct (99%)

32.4%

Conf 43.5%

Full Comparison with Benchmark Evidence →
Full Use-Case PageBrowse All Use CasesHow We Score

Related Lookups

Best LLM for Code Generation

Benchmark-backed ranking of models for generating correct, secure code from requirements.

Best LLM for Debugging

Find the top-ranked models for localizing bugs and proposing fixes with explanations.

Best LLM for Unit Test Generation

Ranked models for generating meaningful unit tests and edge cases from code.

Best LLM for Code Review

Compare models for automated PR review covering correctness, security, and maintainability.

Best LLM for Refactoring

Ranked models for safely refactoring code while preserving behavior and improving clarity.

Best LLM for IDE Code Completion

Compare models for fast, accurate local-context code completion and snippet generation.