BasedAGIBasedAGI
Menu
Rankings live

insurance

FNOL structuring

Extract structured FNOL fields from claims narratives.

#1 Recommendation

gpt-4.1-20250414

Strong on Galileo Agent Leaderboard v2 Insurance AC (85%) and MMLongBench-Doc Leaderboard acc_score_pct (75%)

external/openai/gpt-4-1-20250414

21.9%

Score

31.2%

Confidence

Limited benchmark evidence for this use case.

49 ranked models with average evidence of 13.0 points. Rankings may shift as more benchmark data is ingested.

Ranked Models

30

Evidence Quality

79%

Scoring

Benchmark-backed

Top Signal

Galileo Agent Leaderboard v2: Insurance AC

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gpt-4.1-20250414

Strong on Galileo Agent Leaderboard v2 Insurance AC (85%) and MMLongBench-Doc Leaderboard acc_score_pct (75%)

21.9%
#2claude-sonnet-4-20250514

Strong on Galileo Agent Leaderboard v2 Insurance TSQ (98%) and Galileo Agent Leaderboard v2 Insurance AC (62%)

19.6%
#3gemini-2.5-pro

Strong on Galileo Agent Leaderboard v2 Insurance AC (64%) and Galileo Agent Leaderboard v2 Insurance TSQ (83%)

19.6%
#4Grok-4-0709
19.4%
#5qwen-2.5-72b-instruct
18.2%
#6gemini-2.5-flash
16.2%
#15gemini-3-pro-preview
13.4%
#17google/gemini-3.1-pro-preview
12.2%
#18gpt-4.1-mini-20250414
12.1%
#20gpt-4o
11.7%
#22Kimi-K2-Instruct
11.6%
#23GLM-4.5-Air
11.3%
#24gpt-5-2025-08-07
11.2%
#26openai/gpt-5.4-2026-03-05
11.0%
#27gpt-5.1-2025-11-13
10.7%
#28anthropic/claude-sonnet-4.6
10.6%
#29claude-opus-4-5-20251101
10.6%
#31gpt-5-mini-2025-08-07
10.3%
#32gpt-4o-20241120
10.2%
#34anthropic/claude-opus-4-6-thinking
10.1%
#35gemini-3-flash-preview
10.1%
#37gpt-5.2-2025-12-11
9.9%
#39anthropic/claude-opus-4-5-20251101-thinking
9.8%
#40deepseek-v3
9.6%
#42openai/gpt-4o-mini-2024-07-18
9.1%
#43kimi/kimi-k2.5-thinking
9.1%
#44anthropic/claude-sonnet-4-5-20250929-thinking
8.9%
#45xai-org/grok-4-fast-reasoning
8.8%
#47Qwen3-235B-A22B-Thinking-2507
8.6%
#48gpt-4o-2024-08-06
8.4%

Compare Models

Model A leads by +2.2%

Shareable Link →

Model A

gpt-4.1-20250414

external/openai/gpt-4-1-20250414

21.9%

Rank #1

Confidence 31.2%20 evidence pts

Galileo Agent Leaderboard v2: Insurance AC

Value 85.5% · Conf 100.0% · Weight 3.9%

galileo_agent_v2.insurance_ac (Mar 12, 2026)

MMLongBench-Doc Leaderboard: acc_score_pct

Value 74.6% · Conf 100.0% · Weight 2.4%

mmlongbench_doc_leaderboard.acc_score_pct (Mar 12, 2026)

Galileo Agent Leaderboard v2: Avg AC

Value 100.0% · Conf 100.0% · Weight 2.3%

galileo_agent_v2.avg_ac (Mar 12, 2026)

Galileo Agent Leaderboard v2: Insurance TSQ

Value 35.0% · Conf 100.0% · Weight 1.1%

galileo_agent_v2.insurance_tsq (Mar 12, 2026)

Model B

claude-sonnet-4-20250514

external/anthropic/claude-sonnet-4-20250514

19.6%

Rank #2

Confidence 27.2%19 evidence pts

Galileo Agent Leaderboard v2: Insurance TSQ

Value 97.5% · Conf 100.0% · Weight 3.1%

galileo_agent_v2.insurance_tsq (Mar 12, 2026)

Galileo Agent Leaderboard v2: Insurance AC

Value 61.8% · Conf 100.0% · Weight 2.8%

galileo_agent_v2.insurance_ac (Mar 12, 2026)

Galileo Agent Leaderboard v2: Avg AC

Value 84.8% · Conf 100.0% · Weight 1.9%

galileo_agent_v2.avg_ac (Mar 12, 2026)

Galileo Agent Leaderboard v2: Avg TSQ

Value 94.9% · Conf 100.0% · Weight 1.5%

galileo_agent_v2.avg_tsq (Mar 12, 2026)

Ranking Diagnostics & Missing Models

Source Lift

Ranked

49

Sources

8

Quality

Insufficient

Vals CorpFin v2

vals_corp_fin_v2

37 rows

0.5% avg lift

Vals Legal Bench

vals_legal_bench

36 rows

0.6% avg lift

Vals Tax Eval v2

vals_tax_eval_v2

36 rows

0.6% avg lift

Vals GPQA

vals_gpqa

35 rows

0.5% avg lift

Missing Strong Models

zai/glm-5-thinking

external/zai/glm-5-thinking

Rank #32

13.0%

Thin evidence after weighting

x-ai/grok-3

external/x-ai/grok-3

Rank #35

12.1%

Thin evidence after weighting

qwen/qwen3-max

external/qwen/qwen3-max

Rank #55

10.3%

Thin evidence after weighting

Command A (03-2025)

external/cohere/command-a-03-2025

Rank #72

8.5%

Thin evidence after weighting
Taxonomy Details

Core Tasks

task.claims_field_extractiontask.json_schema_filling

Required Modes

mode.json_schema

Domains

domain.insurance_claims

Related Use Cases