legal
Regulatory summary
Summarize and compare regulatory text with conservative interpretation.
#1 Recommendation
gemini-2.5-pro
Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and LEXam Leaderboard average_score_pct (89%)
external/google/gemini-2-5-pro
32.7%
Score
50.9%
Confidence
Limited benchmark evidence for this use case.
49 ranked models with average evidence of 16.1 points. Rankings may shift as more benchmark data is ingested.
Ranked Models
30
Evidence Quality
84%
Scoring
Benchmark-backed
Top Signal
FACTS Benchmark Suite: facts_grounding_score_pct
All Ranked Models
Compare Models
Model A leads by +0.2%
Shareable Link →Model A
gemini-2.5-pro
external/google/gemini-2-5-pro
Rank #1
FACTS Benchmark Suite: facts_grounding_score_pct
Value 100.0% · Conf 100.0% · Weight 3.4%
facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)
LEXam Leaderboard: average_score_pct
Value 89.4% · Conf 100.0% · Weight 2.1%
lexam_leaderboard.average_score_pct (Mar 12, 2026)
Vectara HHEM Leaderboard: overall_hallucination_error_pct
Value 76.0% · Conf 100.0% · Weight 2.0%
vectara_hhem_leaderboard.overall_hallucination_error_pct (Mar 12, 2026)
Galileo Agent Leaderboard v2: Avg TSQ
Value 79.5% · Conf 100.0% · Weight 1.8%
galileo_agent_v2.avg_tsq (Mar 12, 2026)
Model B
gemini-3-pro-preview
external/google/gemini-3-pro-preview
Rank #2
FACTS Benchmark Suite: facts_grounding_score_pct
Value 88.3% · Conf 100.0% · Weight 3.0%
facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)
Vals Legal Bench: overall_accuracy_pct
Value 99.2% · Conf 100.0% · Weight 2.2%
vals_legal_bench.overall_accuracy_pct (Mar 12, 2026)
FACTS Benchmark Suite: facts_search_score_pct
Value 100.0% · Conf 100.0% · Weight 1.9%
facts_benchmark_suite.facts_search_score_pct (Mar 12, 2026)
LEXam Leaderboard: average_score_pct
Value 75.9% · Conf 100.0% · Weight 1.8%
lexam_leaderboard.average_score_pct (Mar 12, 2026)
▶Ranking Diagnostics & Missing Models
Source Lift
Ranked
49
Sources
8
Quality
Insufficient
Vals CorpFin v2
vals_corp_fin_v2
42 rows
1.2% avg lift
Vals Legal Bench
vals_legal_bench
41 rows
2.0% avg lift
Vals MedQA
vals_medqa
32 rows
0.3% avg lift
Vals Finance Agent
vals_finance_agent
29 rows
1.2% avg lift
Missing Strong Models
gpt-4o
external/openai/gpt-4o
Rank #22
15.2%
▶Taxonomy Details
Core Tasks
Required Modes
Domains
Related Use Cases
legal
Contract Q&A (RAG grounded)
Answer contract questions grounded in the actual contract text.
Top: gemini-2.5-pro
legal
Contract redline summary
Summarize material changes between contract versions with clause refs.
Top: gemini-2.5-pro
legal
Clause playbook check
Check extracted terms against a playbook and flag deviations.
Top: gemini-2.5-pro
legal
Contract term extraction
Extract key terms into structured fields with clause references.
Top: gemini-2.5-pro