BasedAGIBasedAGI
Productivity

Invoice and receipt extraction (text)

Extract structured expense fields from invoice/receipt text.

task.invoice_receipt_extractiontask.json_schema_filling
Evidence quality is currently limited for this use case. Rankings below are useful for exploration, not a strong winner claim.

Provisional leader

gemini-3.1-pro-preview

Current leader based on limited benchmark evidence. Treat this ranking as directional until coverage improves.

24.6%

Best benchmark score

28.5%

Confidence

Ranked Models

30

Evidence Quality

81%

Evidence Points

23

Top Signal

Vals Finance Agent: overall_accuracy_pct

All Ranked Models

30 of 30 models
RankModelScore
๐Ÿฅ‡gemini-3.1-pro-preview

Strong on Vals Finance Agent overall_accuracy_pct and SimpleQA Verified simpleqa_verified_score_pct

24.6%
๐Ÿฅˆgpt-5-2025-08-07

Strong on Vals Finance Agent overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct

22.8%
๐Ÿฅ‰gemini-2.5-pro

Strong on Galileo Agent Leaderboard v2 Avg TSQ and FACTS Benchmark Suite facts_grounding_score_pct

22.6%
#4claude-sonnet-4

Strong on Galileo Agent Leaderboard v2 Avg TSQ and LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct

20.1%
#5gpt-5-mini-2025-08-07

Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct

20.0%
#6Grok-4-0709

Strong on Galileo Agent Leaderboard v2 Avg TSQ and Vals Finance Agent overall_accuracy_pct

18.9%
#7gpt-4.1-20250414

Strong on Galileo Agent Leaderboard v2 Avg TSQ and Vectara HHEM Leaderboard overall_hallucination_error_pct

18.6%
#8gemini-2.5-flash

Strong on Galileo Agent Leaderboard v2 Avg TSQ and LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct

18.3%
#9gemini-3-pro-preview

Strong on Vals Finance Agent overall_accuracy_pct and SimpleQA Verified simpleqa_verified_score_pct

18.0%
#10claude-sonnet-4.6

Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct

17.5%
#11gpt-5.2-2025-12-11

Strong on Vals Finance Agent overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct

16.9%
#12gemini-3.1-flash-lite-preview

Strong on Vals Finance Agent overall_accuracy_pct and Vals Mortgage Tax overall_accuracy_pct

16.9%
#13gpt-5.4-2026-03-05

Strong on Vals Finance Agent overall_accuracy_pct and Vals Mortgage Tax overall_accuracy_pct

16.9%
#14gemini-3-flash-preview

Strong on Vals Finance Agent overall_accuracy_pct and FACTS Benchmark Suite average_score_pct

15.9%
#15gpt-5.1-2025-11-13

Strong on Vals Finance Agent overall_accuracy_pct and Vals Case Law v2 overall_accuracy_pct

15.2%
#16claude-opus-4-5-20251101

Strong on Vals Mortgage Tax overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct

14.2%
#17o3-20250416

Strong on Vals Mortgage Tax overall_accuracy_pct and SciArena Leaderboard rating_elo

13.6%
#18grok-4-fast-reasoning

Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct

13.1%
#19claude-opus-4-6-thinking

Strong on Vals Finance Agent overall_accuracy_pct and Vals Mortgage Tax overall_accuracy_pct

12.2%
#20Claude-3.5-Sonnet

Strong on LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct and LLM-AggreFact Leaderboard average_score_pct

11.5%
#21claude-opus-4-5-20251101-thinking

Strong on Vals Finance Agent overall_accuracy_pct and Vals Mortgage Tax overall_accuracy_pct

11.4%
#22kimi-k2.5-thinking

Strong on Vals Finance Agent overall_accuracy_pct and Vals Mortgage Tax overall_accuracy_pct

11.0%
#23claude-sonnet-4-5-20250929-thinking

Strong on Vals Finance Agent overall_accuracy_pct and Vals Mortgage Tax overall_accuracy_pct

10.8%
#24grok-4-1-fast-reasoning

Strong on Vals Finance Agent overall_accuracy_pct and Vectara HHEM Leaderboard business_answer_rate_pct

10.6%
#25qwen-2.5-72b-instruct

Strong on Galileo Agent Leaderboard v2 Avg TSQ and DuckDB NSQL Leaderboard all_execution_accuracy

10.5%
#26claude-opus-4-1-20250805

Strong on Vals Mortgage Tax overall_accuracy_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

10.4%
#27gpt-4o

Strong on CRMArena Function Calling overall_score_pct and JSONSchemaBench Leaderboard medium_schema_compliance_pct

10.1%
#28gpt-4o-2024-08-06

Strong on DuckDB NSQL Leaderboard all_execution_accuracy and Vals Mortgage Tax overall_accuracy_pct

10.1%
#33grok-3

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and SimpleQA Verified simpleqa_verified_score_pct

9.3%
#34grok-4.20-0309-reasoning

Strong on Vals Finance Agent overall_accuracy_pct and Vals Finance Agent complex_retrieval_accuracy_pct

9.3%

Compare Models

Select two different models above to compare their evidence side by side.
โ–ถRanking diagnostics & missing models

Source lift

Ranked

58

Sources

8

Quality

Low

Vals Mortgage Tax

38 rows ยท 1.3% avg lift

Vals Legal Bench

37 rows ยท 0.4% avg lift

Vals MedQA

36 rows ยท 0.4% avg lift

Vals Tax Eval v2

36 rows ยท 0.4% avg lift

Missing frontier models

No obvious gaps right now.

โ–ถTaxonomy & task details

Core tasks

task.invoice_receipt_extractiontask.json_schema_filling

Required modes

mode.json_schema

Domains

domain.general_business

Related in Productivity