BasedAGIBasedAGI
Menu
Rankings live

real_estate

Lease abstraction

Extract key lease terms and schedules into structured output.

#1 Recommendation

gemini-3-pro-preview

Strong on LEXam Leaderboard average_score_pct (76%) and FACTS Benchmark Suite facts_grounding_score_pct (88%)

external/google/gemini-3-pro-preview

23.6%

Score

30.8%

Confidence

Limited benchmark evidence for this use case.

45 ranked models with average evidence of 15.4 points. Rankings may shift as more benchmark data is ingested.

Ranked Models

30

Evidence Quality

79%

Scoring

Benchmark-backed

Top Signal

LEXam Leaderboard: average_score_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gemini-3-pro-preview

Strong on LEXam Leaderboard average_score_pct (76%) and FACTS Benchmark Suite facts_grounding_score_pct (88%)

23.6%
#2gemini-2.5-pro

Strong on LEXam Leaderboard average_score_pct (89%) and FACTS Benchmark Suite facts_grounding_score_pct (100%)

22.6%
#3gpt-4.1-20250414

Strong on MMLongBench-Doc Leaderboard acc_score_pct (75%) and Galileo Agent Leaderboard v2 Avg AC (100%)

19.2%
#4Grok-4-0709
15.3%
#5anthropic/claude-sonnet-4.6
15.2%
#6gpt-5-mini-2025-08-07
14.9%
#7gpt-5-2025-08-07
14.7%
#8google/gemini-3.1-pro-preview
14.0%
#9openai/gpt-5.4-2026-03-05
13.7%
#10claude-sonnet-4-20250514
13.4%
#11claude-opus-4-5-20251101
13.3%
#12gemini-2.5-flash
12.5%
#13gpt-5.1-2025-11-13
12.2%
#15gemini-3-flash-preview
11.9%
#16google/gemini-3.1-flash-lite-preview
11.4%
#19xai-org/grok-4-fast-reasoning
11.2%
#24xai-org/grok-4-1-fast-reasoning
10.7%
#25anthropic/claude-opus-4-6-thinking
10.7%
#26gpt-5.2-2025-12-11
10.6%
#29kimi/kimi-k2.5-thinking
10.1%
#30anthropic/claude-opus-4-5-20251101-thinking
9.9%
#31deepseek/deepseek-r1
9.6%
#32anthropic/claude-sonnet-4-5-20250929-thinking
9.3%
#34zai/glm-5-thinking
9.0%
#35x-ai/grok-3
8.9%
#36gpt-4o
8.5%
#38o3-20250416
8.4%
#39mistralai/mistral-large-2512
8.3%
#40anthropic/claude-haiku-4-5-20251001-thinking
8.2%
#42alibaba/qwen3.5-flash
8.1%

Compare Models

Model A leads by +0.9%

Shareable Link →

Model A

gemini-3-pro-preview

external/google/gemini-3-pro-preview

23.6%

Rank #1

Confidence 30.8%24 evidence pts

LEXam Leaderboard: average_score_pct

Value 75.9% · Conf 100.0% · Weight 2.1%

lexam_leaderboard.average_score_pct (Mar 12, 2026)

FACTS Benchmark Suite: facts_grounding_score_pct

Value 88.3% · Conf 100.0% · Weight 2.0%

facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)

FACTS Benchmark Suite: facts_search_score_pct

Value 100.0% · Conf 100.0% · Weight 1.7%

facts_benchmark_suite.facts_search_score_pct (Mar 12, 2026)

FACTS Benchmark Suite: average_score_pct

Value 100.0% · Conf 100.0% · Weight 1.6%

facts_benchmark_suite.average_score_pct (Mar 12, 2026)

Model B

gemini-2.5-pro

external/google/gemini-2-5-pro

22.6%

Rank #2

Confidence 33.0%24 evidence pts

LEXam Leaderboard: average_score_pct

Value 89.4% · Conf 100.0% · Weight 2.5%

lexam_leaderboard.average_score_pct (Mar 12, 2026)

FACTS Benchmark Suite: facts_grounding_score_pct

Value 100.0% · Conf 100.0% · Weight 2.2%

facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)

Vectara HHEM Leaderboard: overall_hallucination_error_pct

Value 76.0% · Conf 100.0% · Weight 1.8%

vectara_hhem_leaderboard.overall_hallucination_error_pct (Mar 12, 2026)

Vals CorpFin v2: overall_accuracy_pct

Value 78.4% · Conf 100.0% · Weight 1.4%

vals_corp_fin_v2.overall_accuracy_pct (Mar 12, 2026)

Ranking Diagnostics & Missing Models

Source Lift

Ranked

45

Sources

8

Quality

Insufficient

Vals CorpFin v2

vals_corp_fin_v2

40 rows

1.2% avg lift

Vals Legal Bench

vals_legal_bench

35 rows

0.3% avg lift

Vals Tax Eval v2

vals_tax_eval_v2

35 rows

0.3% avg lift

Vals MedQA

vals_medqa

34 rows

0.3% avg lift

Missing Strong Models

gpt-4o-2024-05-13

external/openai/gpt-4o-2024-05-13

Rank #51

10.5%

Thin evidence after weighting

google/gemini-2.0-flash-001

external/google/gemini-2-0-flash-001

Rank #56

10.3%

Thin evidence after weighting

deepseek-v3

external/deepseek-ai/deepseek-v3

Rank #66

8.8%

Thin evidence after weighting

GPT-4.1-nano-2025-04-14

external/openai/gpt-4-1-nano-2025-04-14

Rank #89

6.4%

Thin evidence after weighting
Taxonomy Details

Core Tasks

task.contract_term_extractiontask.table_extraction_to_csv

Required Modes

mode.long_contextmode.json_schema

Domains

domain.real_estate_leases

Related Use Cases