insurance
Fraud signal summary
Summarize potential fraud indicators with conservative evidence framing.
#1 Recommendation
gemini-2.5-pro
Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (76%)
external/google/gemini-2-5-pro
27.0%
Score
41.6%
Confidence
Limited benchmark evidence for this use case.
51 ranked models with average evidence of 15.3 points. Rankings may shift as more benchmark data is ingested.
Ranked Models
30
Evidence Quality
81%
Scoring
Benchmark-backed
Top Signal
FACTS Benchmark Suite: facts_grounding_score_pct
All Ranked Models
Compare Models
Model A leads by +0.2%
Shareable Link →Model A
gemini-2.5-pro
external/google/gemini-2-5-pro
Rank #1
FACTS Benchmark Suite: facts_grounding_score_pct
Value 100.0% · Conf 100.0% · Weight 2.6%
facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)
Vectara HHEM Leaderboard: overall_hallucination_error_pct
Value 76.0% · Conf 100.0% · Weight 2.1%
vectara_hhem_leaderboard.overall_hallucination_error_pct (Mar 12, 2026)
Vals CorpFin v2: overall_accuracy_pct
Value 78.4% · Conf 100.0% · Weight 1.6%
vals_corp_fin_v2.overall_accuracy_pct (Mar 12, 2026)
Galileo Agent Leaderboard v2: Insurance AC
Value 63.6% · Conf 100.0% · Weight 1.6%
galileo_agent_v2.insurance_ac (Mar 12, 2026)
Model B
gpt-4.1-20250414
external/openai/gpt-4-1-20250414
Rank #2
Vectara HHEM Leaderboard: overall_hallucination_error_pct
Value 82.5% · Conf 100.0% · Weight 2.2%
vectara_hhem_leaderboard.overall_hallucination_error_pct (Mar 12, 2026)
Galileo Agent Leaderboard v2: Insurance AC
Value 85.5% · Conf 100.0% · Weight 2.1%
galileo_agent_v2.insurance_ac (Mar 12, 2026)
Vals CorpFin v2: overall_accuracy_pct
Value 84.9% · Conf 100.0% · Weight 1.8%
vals_corp_fin_v2.overall_accuracy_pct (Mar 12, 2026)
OpenVLM OCRBench Official: ocrbench_score_pct
Value 87.7% · Conf 100.0% · Weight 1.5%
openvlm_ocrbench_official.ocrbench_score_pct (Mar 12, 2026)
▶Ranking Diagnostics & Missing Models
Source Lift
Ranked
51
Sources
8
Quality
Insufficient
Vals CorpFin v2
vals_corp_fin_v2
42 rows
1.3% avg lift
Vals Legal Bench
vals_legal_bench
36 rows
0.3% avg lift
Vals MedQA
vals_medqa
34 rows
0.3% avg lift
Vals LiveCodeBench
vals_lcb
34 rows
0.3% avg lift
Missing Strong Models
No obvious gaps right now.
▶Taxonomy Details
Core Tasks
Required Modes
Domains
Related Use Cases
insurance
Litigation risk memo
Summarize a claim into litigation risk drivers and mitigation steps.
Top: gemini-2.5-pro
insurance
Policy wording comparison
Compare policy wording against a standard and flag material differences.
Top: gemini-2.5-pro
insurance
Claims summary
Summarize claim history into timeline, status, and open items.
Top: gpt-4.1-20250414
insurance
FNOL structuring
Extract structured FNOL fields from claims narratives.
Top: gpt-4.1-20250414