BasedAGIBasedAGI
Menu
Rankings live

insurance

Claims summary

Summarize claim history into timeline, status, and open items.

#1 Recommendation

gpt-4.1-20250414

Strong on MMLongBench-Doc Leaderboard acc_score_pct (75%) and Galileo Agent Leaderboard v2 Insurance AC (85%)

external/openai/gpt-4-1-20250414

27.7%

Score

39.3%

Confidence

Runners-up:#2 claude-sonnet-4-20250514 (21.9%)#3 gemini-2.5-pro (21.9%)#4 Grok-4-0709 (21.6%)

Limited benchmark evidence for this use case.

55 ranked models with average evidence of 12.2 points. Rankings may shift as more benchmark data is ingested.

Ranked Models

30

Evidence Quality

80%

Scoring

Benchmark-backed

Top Signal

MMLongBench-Doc Leaderboard: acc_score_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gpt-4.1-20250414

Strong on MMLongBench-Doc Leaderboard acc_score_pct (75%) and Galileo Agent Leaderboard v2 Insurance AC (85%)

27.7%
#2claude-sonnet-4-20250514

Strong on Galileo Agent Leaderboard v2 Insurance TSQ (98%) and Galileo Agent Leaderboard v2 Insurance AC (62%)

21.9%
#3gemini-2.5-pro

Strong on Galileo Agent Leaderboard v2 Insurance AC (64%) and Galileo Agent Leaderboard v2 Insurance TSQ (83%)

21.9%
#4Grok-4-0709
21.6%
#5qwen-2.5-72b-instruct
20.3%
#6gemini-2.5-flash
18.1%
#7gemini-3-pro-preview
14.9%
#9gpt-4o-20241120
14.2%
#10google/gemini-3.1-pro-preview
13.6%
#11gpt-4.1-mini-20250414
13.5%
#13gpt-4o
13.1%
#15Kimi-K2-Instruct
12.9%
#16GLM-4.5-Air
12.6%
#17gpt-5-2025-08-07
12.5%
#18openai/gpt-5.4-2026-03-05
12.3%
#19gpt-5.1-2025-11-13
11.9%
#20anthropic/claude-sonnet-4.6
11.8%
#21claude-opus-4-5-20251101
11.8%
#23gpt-5-mini-2025-08-07
11.5%
#24anthropic/claude-opus-4-6-thinking
11.2%
#25gemini-3-flash-preview
11.2%
#26gpt-5.2-2025-12-11
11.1%
#27anthropic/claude-opus-4-5-20251101-thinking
10.9%
#28deepseek-v3
10.8%
#29openai/gpt-4o-mini-2024-07-18
10.2%
#30kimi/kimi-k2.5-thinking
10.1%
#31Llama-2-7b-chat-hf
10.0%
#33anthropic/claude-sonnet-4-5-20250929-thinking
9.9%
#34xai-org/grok-4-fast-reasoning
9.8%
#35Qwen3-235B-A22B-Thinking-2507
9.6%

Compare Models

Model A leads by +5.8%

Shareable Link →

Model A

gpt-4.1-20250414

external/openai/gpt-4-1-20250414

27.7%

Rank #1

Confidence 39.3%20 evidence pts

MMLongBench-Doc Leaderboard: acc_score_pct

Value 74.6% · Conf 100.0% · Weight 4.5%

mmlongbench_doc_leaderboard.acc_score_pct (Mar 12, 2026)

Galileo Agent Leaderboard v2: Insurance AC

Value 85.5% · Conf 100.0% · Weight 3.7%

galileo_agent_v2.insurance_ac (Mar 12, 2026)

Galileo Agent Leaderboard v2: Avg AC

Value 100.0% · Conf 100.0% · Weight 2.2%

galileo_agent_v2.avg_ac (Mar 12, 2026)

Galileo Agent Leaderboard v2: Insurance TSQ

Value 35.0% · Conf 100.0% · Weight 1.1%

galileo_agent_v2.insurance_tsq (Mar 12, 2026)

Model B

claude-sonnet-4-20250514

external/anthropic/claude-sonnet-4-20250514

21.9%

Rank #2

Confidence 30.4%19 evidence pts

Galileo Agent Leaderboard v2: Insurance TSQ

Value 97.5% · Conf 100.0% · Weight 2.9%

galileo_agent_v2.insurance_tsq (Mar 12, 2026)

Galileo Agent Leaderboard v2: Insurance AC

Value 61.8% · Conf 100.0% · Weight 2.7%

galileo_agent_v2.insurance_ac (Mar 12, 2026)

Galileo Agent Leaderboard v2: Avg AC

Value 84.8% · Conf 100.0% · Weight 1.8%

galileo_agent_v2.avg_ac (Mar 12, 2026)

Galileo Agent Leaderboard v2: Avg TSQ

Value 94.9% · Conf 100.0% · Weight 1.4%

galileo_agent_v2.avg_tsq (Mar 12, 2026)

▶Ranking Diagnostics & Missing Models

Source Lift

Ranked

55

Sources

8

Quality

Insufficient

Vals CorpFin v2

vals_corp_fin_v2

39 rows

0.5% avg lift

Vals Legal Bench

vals_legal_bench

38 rows

0.6% avg lift

Vals Tax Eval v2

vals_tax_eval_v2

38 rows

0.5% avg lift

Vals GPQA

vals_gpqa

37 rows

0.5% avg lift

Missing Strong Models

x-ai/grok-3

external/x-ai/grok-3

Rank #35

12.1%

Thin evidence after weighting

qwen/qwen3-max

external/qwen/qwen3-max

Rank #55

10.3%

Thin evidence after weighting

Llama-4-Scout-17B-16E-Instruct

external/meta/llama-4-scout-17b-16e-instruct

Rank #73

8.4%

Thin evidence after weighting
▶Taxonomy Details

Core Tasks

task.summarize_doctask.timeline_extraction

Required Modes

mode.long_context

Domains

domain.insurance_claims

Related Use Cases

insurance

Litigation risk memo

Summarize a claim into litigation risk drivers and mitigation steps.

Top: gemini-2.5-pro

insurance

Policy wording comparison

Compare policy wording against a standard and flag material differences.

Top: gemini-2.5-pro

insurance

Fraud signal summary

Summarize potential fraud indicators with conservative evidence framing.

Top: gemini-2.5-pro

insurance

FNOL structuring

Extract structured FNOL fields from claims narratives.

Top: gpt-4.1-20250414