BasedAGIBasedAGI
Menu
Rankings live

insurance

Underwriting submission ingest

Convert messy submission docs into structured underwriting fields.

#1 Recommendation

gpt-4.1-20250414

Strong on MMLongBench-Doc Leaderboard acc_score_pct (75%) and Galileo Agent Leaderboard v2 Insurance AC (85%)

external/openai/gpt-4-1-20250414

21.2%

Score

30.0%

Confidence

Limited benchmark evidence for this use case.

32 ranked models with average evidence of 13.5 points. Rankings may shift as more benchmark data is ingested.

Ranked Models

30

Evidence Quality

79%

Scoring

Benchmark-backed

Top Signal

MMLongBench-Doc Leaderboard: acc_score_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gpt-4.1-20250414

Strong on MMLongBench-Doc Leaderboard acc_score_pct (75%) and Galileo Agent Leaderboard v2 Insurance AC (85%)

21.2%
#2claude-sonnet-4-20250514

Strong on Galileo Agent Leaderboard v2 Insurance TSQ (98%) and Galileo Agent Leaderboard v2 Insurance AC (62%)

17.0%
#3gemini-2.5-pro

Strong on Galileo Agent Leaderboard v2 Insurance AC (64%) and Galileo Agent Leaderboard v2 Insurance TSQ (83%)

17.0%
#4Grok-4-0709
16.8%
#5qwen-2.5-72b-instruct
15.7%
#6gemini-2.5-flash
14.0%
#15gemini-3-pro-preview
11.6%
#17gpt-4o-20241120
10.7%
#18google/gemini-3.1-pro-preview
10.6%
#19gpt-4.1-mini-20250414
10.5%
#21gpt-4o
10.2%
#23Kimi-K2-Instruct
10.0%
#24GLM-4.5-Air
9.8%
#25gpt-5-2025-08-07
9.7%
#27openai/gpt-5.4-2026-03-05
9.5%
#28gpt-5.1-2025-11-13
9.3%
#29anthropic/claude-sonnet-4.6
9.2%
#30claude-opus-4-5-20251101
9.1%
#33gpt-5-mini-2025-08-07
8.9%
#35gemini-3-flash-preview
8.7%
#38deepseek-v3
8.4%
#40openai/gpt-4o-mini-2024-07-18
7.9%
#41kimi/kimi-k2.5-thinking
7.9%
#42xai-org/grok-4-fast-reasoning
7.6%
#43Qwen3-235B-A22B-Thinking-2507
7.5%
#44gpt-4o-2024-08-06
7.3%
#46google/gemini-3.1-flash-lite-preview
7.2%
#47xai-org/grok-4-1-fast-reasoning
7.2%
#51GPT-4.1-nano-2025-04-14
5.8%
#52Meta-Llama-3-8B-Instruct
5.7%

Compare Models

Model A leads by +4.1%

Shareable Link →

Model A

gpt-4.1-20250414

external/openai/gpt-4-1-20250414

21.2%

Rank #1

Confidence 30.0%20 evidence pts

MMLongBench-Doc Leaderboard: acc_score_pct

Value 74.6% · Conf 100.0% · Weight 3.5%

mmlongbench_doc_leaderboard.acc_score_pct (Mar 12, 2026)

Galileo Agent Leaderboard v2: Insurance AC

Value 85.5% · Conf 100.0% · Weight 3.1%

galileo_agent_v2.insurance_ac (Mar 12, 2026)

Galileo Agent Leaderboard v2: Avg AC

Value 100.0% · Conf 100.0% · Weight 1.8%

galileo_agent_v2.avg_ac (Mar 12, 2026)

Galileo Agent Leaderboard v2: Insurance TSQ

Value 35.0% · Conf 100.0% · Weight 0.9%

galileo_agent_v2.insurance_tsq (Mar 12, 2026)

Model B

claude-sonnet-4-20250514

external/anthropic/claude-sonnet-4-20250514

17.0%

Rank #2

Confidence 23.6%19 evidence pts

Galileo Agent Leaderboard v2: Insurance TSQ

Value 97.5% · Conf 100.0% · Weight 2.5%

galileo_agent_v2.insurance_tsq (Mar 12, 2026)

Galileo Agent Leaderboard v2: Insurance AC

Value 61.8% · Conf 100.0% · Weight 2.2%

galileo_agent_v2.insurance_ac (Mar 12, 2026)

Galileo Agent Leaderboard v2: Avg AC

Value 84.8% · Conf 100.0% · Weight 1.5%

galileo_agent_v2.avg_ac (Mar 12, 2026)

Galileo Agent Leaderboard v2: Avg TSQ

Value 94.9% · Conf 100.0% · Weight 1.2%

galileo_agent_v2.avg_tsq (Mar 12, 2026)

Ranking Diagnostics & Missing Models

Source Lift

Ranked

32

Sources

8

Quality

Insufficient

Vals CorpFin v2

vals_corp_fin_v2

23 rows

0.4% avg lift

Vals Legal Bench

vals_legal_bench

21 rows

0.5% avg lift

Vals Tax Eval v2

vals_tax_eval_v2

21 rows

0.5% avg lift

Vals MedQA

vals_medqa

20 rows

0.5% avg lift

Missing Strong Models

gpt-5.2-2025-12-11

external/openai/gpt-5-2-2025-12-11

Rank #16

16.2%

Thin evidence after weighting

anthropic/claude-opus-4-6-thinking

external/anthropic/claude-opus-4-6-thinking

Rank #17

16.1%

Thin evidence after weighting

anthropic/claude-opus-4-5-20251101-thinking

external/anthropic/claude-opus-4-5-20251101-thinking

Rank #21

15.2%

Thin evidence after weighting

anthropic/claude-sonnet-4-5-20250929-thinking

external/anthropic/claude-sonnet-4-5-20250929-thinking

Rank #28

14.1%

Thin evidence after weighting
Taxonomy Details

Core Tasks

task.entity_extractiontask.json_schema_filling

Required Modes

mode.json_schema

Domains

domain.insurance_underwriting

Related Use Cases